Apr 11 16:56:43 user devstack@n-api.service[61421]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 16:56:43 user devstack@n-api.service[61421]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 11 16:56:43 2023] *** Apr 11 16:56:43 user devstack@n-api.service[61421]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 11 16:56:43 user devstack@n-api.service[61421]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 11 16:56:43 user devstack@n-api.service[61421]: nodename: user Apr 11 16:56:43 user devstack@n-api.service[61421]: machine: x86_64 Apr 11 16:56:43 user devstack@n-api.service[61421]: clock source: unix Apr 11 16:56:43 user devstack@n-api.service[61421]: pcre jit disabled Apr 11 16:56:43 user devstack@n-api.service[61421]: detected number of CPU cores: 12 Apr 11 16:56:43 user devstack@n-api.service[61421]: current working directory: / Apr 11 16:56:43 user devstack@n-api.service[61421]: detected binary path: /usr/bin/uwsgi-core Apr 11 16:56:43 user devstack@n-api.service[61421]: your processes number limit is 63637 Apr 11 16:56:43 user devstack@n-api.service[61421]: your memory page size is 4096 bytes Apr 11 16:56:43 user devstack@n-api.service[61421]: detected max file descriptor number: 2048 Apr 11 16:56:43 user devstack@n-api.service[61421]: lock engine: pthread robust mutexes Apr 11 16:56:43 user devstack@n-api.service[61421]: thunder lock: enabled Apr 11 16:56:43 user devstack@n-api.service[61421]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 16:56:43 user devstack@n-api.service[61421]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 11 16:56:43 user devstack@n-api.service[61421]: Python main interpreter initialized at 0x55b8891a0990 Apr 11 16:56:43 user devstack@n-api.service[61421]: python threads support enabled Apr 11 16:56:43 user devstack@n-api.service[61421]: your server socket listen backlog is limited to 100 connections Apr 11 16:56:43 user devstack@n-api.service[61421]: your mercy for graceful operations on workers is 90 seconds Apr 11 16:56:43 user devstack@n-api.service[61421]: mapped 537436 bytes (524 KB) for 3 cores Apr 11 16:56:43 user devstack@n-api.service[61421]: *** Operational MODE: preforking *** Apr 11 16:56:43 user devstack@n-api.service[61421]: *** uWSGI is running in multiple interpreter mode *** Apr 11 16:56:43 user devstack@n-api.service[61421]: spawned uWSGI master process (pid: 61421) Apr 11 16:56:43 user devstack@n-api.service[61421]: spawned uWSGI worker 1 (pid: 61422, cores: 1) Apr 11 16:56:43 user devstack@n-api.service[61421]: spawned uWSGI worker 2 (pid: 61423, cores: 1) Apr 11 16:56:43 user devstack@n-api.service[61421]: spawned uWSGI worker 3 (pid: 61424, cores: 1) Apr 11 16:56:43 user devstack@n-api.service[61421]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 16:56:44 user devstack@n-api.service[61424]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 16:56:44 user devstack@n-api.service[61422]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 16:56:44 user devstack@n-api.service[61423]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 16:56:47 user devstack@n-api.service[61424]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 16:56:47 user devstack@n-api.service[61424]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 16:56:47 user devstack@n-api.service[61424]: and ``live_migration_inbound_addr`` respectively. Apr 11 16:56:47 user devstack@n-api.service[61424]: ). Its value may be silently ignored in the future. Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 16:56:47 user devstack@n-api.service[61422]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 16:56:47 user devstack@n-api.service[61422]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 16:56:47 user devstack@n-api.service[61422]: and ``live_migration_inbound_addr`` respectively. Apr 11 16:56:47 user devstack@n-api.service[61422]: ). Its value may be silently ignored in the future. Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 16:56:47 user devstack@n-api.service[61423]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 16:56:47 user devstack@n-api.service[61423]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 16:56:47 user devstack@n-api.service[61423]: and ``live_migration_inbound_addr`` respectively. Apr 11 16:56:47 user devstack@n-api.service[61423]: ). Its value may be silently ignored in the future. Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61424) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61423) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 16:56:47 user devstack@n-api.service[61424]: INFO dbcounter [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Registered counter for database nova_api Apr 11 16:56:47 user devstack@n-api.service[61422]: INFO dbcounter [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Registered counter for database nova_api Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG oslo_db.sqlalchemy.engines [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61424) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writer thread running {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG oslo_db.sqlalchemy.engines [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61422) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writer thread running {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:47 user devstack@n-api.service[61423]: INFO dbcounter [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Registered counter for database nova_api Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG oslo_db.sqlalchemy.engines [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61423) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writer thread running {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG nova.context [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),78278d60-2ff1-4f3e-b533-dd913418cbaf(cell1) {{(pid=61424) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:56:47 user devstack@n-api.service[61424]: INFO dbcounter [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Registered counter for database nova_cell0 Apr 11 16:56:47 user devstack@n-api.service[61424]: INFO dbcounter [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Registered counter for database nova_cell1 Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG nova.context [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),78278d60-2ff1-4f3e-b533-dd913418cbaf(cell1) {{(pid=61422) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG oslo_db.sqlalchemy.engines [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61424) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG oslo_db.sqlalchemy.engines [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61424) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writer thread running {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:47 user devstack@n-api.service[61422]: INFO dbcounter [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Registered counter for database nova_cell0 Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writer thread running {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:47 user devstack@n-api.service[61422]: INFO dbcounter [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Registered counter for database nova_cell1 Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG oslo_db.sqlalchemy.engines [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61422) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writer thread running {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG oslo_db.sqlalchemy.engines [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61422) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG nova.context [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),78278d60-2ff1-4f3e-b533-dd913418cbaf(cell1) {{(pid=61423) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:56:47 user devstack@n-api.service[61423]: INFO dbcounter [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Registered counter for database nova_cell0 Apr 11 16:56:47 user devstack@n-api.service[61423]: INFO dbcounter [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Registered counter for database nova_cell1 Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG oslo_db.sqlalchemy.engines [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61423) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writer thread running {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG oslo_db.sqlalchemy.engines [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61423) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61424]: INFO dbcounter [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Registered counter for database nova_cell0 Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writer thread running {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG oslo_db.sqlalchemy.engines [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61424) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61422]: INFO dbcounter [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Registered counter for database nova_cell0 Apr 11 16:56:47 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writer thread running {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG oslo_db.sqlalchemy.engines [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61422) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writer thread running {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writer thread running {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:47 user devstack@n-api.service[61423]: INFO dbcounter [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Registered counter for database nova_cell0 Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG oslo_db.sqlalchemy.engines [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61423) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 16:56:47 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writer thread running {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 16:56:48 user devstack@n-api.service[61424]: WARNING keystonemiddleware.auth_token [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:56:48 user devstack@n-api.service[61423]: WARNING keystonemiddleware.auth_token [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:56:48 user devstack@n-api.service[61424]: WARNING keystonemiddleware.auth_token [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:56:48 user devstack@n-api.service[61423]: WARNING keystonemiddleware.auth_token [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:56:48 user devstack@n-api.service[61422]: WARNING keystonemiddleware.auth_token [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:56:48 user devstack@n-api.service[61422]: WARNING keystonemiddleware.auth_token [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:56:48 user devstack@n-api.service[61424]: WARNING keystonemiddleware.auth_token [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:56:48 user devstack@n-api.service[61424]: WARNING keystonemiddleware.auth_token [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:56:48 user devstack@n-api.service[61424]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8891a0990 pid: 61424 (default app) Apr 11 16:56:48 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:56:48 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001602 Apr 11 16:56:48 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 11 16:56:48 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:56:48 user devstack@n-api.service[61422]: WARNING keystonemiddleware.auth_token [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:56:48 user devstack@n-api.service[61422]: WARNING keystonemiddleware.auth_token [None req-3b3a1749-0649-4f93-bc06-5732d0c79689 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:56:48 user devstack@n-api.service[61422]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8891a0990 pid: 61422 (default app) Apr 11 16:56:48 user devstack@n-api.service[61423]: WARNING keystonemiddleware.auth_token [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 16:56:48 user devstack@n-api.service[61423]: WARNING keystonemiddleware.auth_token [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 16:56:48 user devstack@n-api.service[61423]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8891a0990 pid: 61423 (default app) Apr 11 16:58:55 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:58:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-5fd7a61e-f136-4f13-8dbf-d76ca84160a4 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002697 Apr 11 16:58:55 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:58:55 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:58:55 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:58:55 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:58:55 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:58:55 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:58:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3ef77155-9065-406f-a46f-c950cac10832 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:58:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3ef77155-9065-406f-a46f-c950cac10832 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.383586 Apr 11 16:58:55 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 16:58:55 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:58:57 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:58:57 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001918 Apr 11 16:58:57 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:58:57 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:58:57 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:58:57 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:58:57 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:58:57 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:58:58 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ac283531-17e2-49d1-9d32-6e4f01fe7885 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "id": "c1", "swap": 0}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:58:58 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ac283531-17e2-49d1-9d32-6e4f01fe7885 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.422491 Apr 11 16:58:58 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 16:58:57 2023] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:58:58 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6be379f8-fb8f-41c9-bbf0-a3986cab0572 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:58:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-6be379f8-fb8f-41c9-bbf0-a3986cab0572 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043540 Apr 11 16:58:58 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 16:58:58 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:59:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001407 Apr 11 16:59:00 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:59:00 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:59:00 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-224ed23e-7ba3-45ab-8a5b-9e400d3cf8f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:00 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-224ed23e-7ba3-45ab-8a5b-9e400d3cf8f9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079333 Apr 11 16:59:00 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 16:59:00 2023] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:59:00 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-836f1783-f353-42a5-932e-cf8a4cd59b1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:00 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-836f1783-f353-42a5-932e-cf8a4cd59b1d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027884 Apr 11 16:59:00 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 16:59:00 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:59:02 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:02 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001296 Apr 11 16:59:02 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:59:02 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:59:02 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-353cd2ac-6561-4580-b6db-6e5daa933de5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "disk": 10, "swap": 0}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:02 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-353cd2ac-6561-4580-b6db-6e5daa933de5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065317 Apr 11 16:59:02 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 16:59:02 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:59:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-06d1a319-a3d3-434c-8159-a0c27878c30a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-06d1a319-a3d3-434c-8159-a0c27878c30a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026593 Apr 11 16:59:02 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 16:59:02 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:59:04 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001342 Apr 11 16:59:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:59:04 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:59:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-979c3bea-a8a1-4ef9-8435-a8267a46674f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-979c3bea-a8a1-4ef9-8435-a8267a46674f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059883 Apr 11 16:59:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 16:59:04 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:59:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-229cfc99-4c2c-4081-9f5d-1eacbc696980 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-229cfc99-4c2c-4081-9f5d-1eacbc696980 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023086 Apr 11 16:59:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 16:59:04 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:59:06 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:06 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001420 Apr 11 16:59:06 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:59:06 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:59:06 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-e55d0439-d625-453d-8c52-be92fe07c249 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "id": "d4", "name": "ds4G"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-e55d0439-d625-453d-8c52-be92fe07c249 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066280 Apr 11 16:59:06 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 16:59:06 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:59:06 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:06 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024778 Apr 11 16:59:06 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 16:59:06 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:59:08 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:08 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f41d1fe7-21fc-4c8a-94ae-6378f9fcd28e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001304 Apr 11 16:59:08 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:59:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:59:08 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1d2dd61e-e556-4562-890c-e25bd225bb0f admin admin] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:08 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-1d2dd61e-e556-4562-890c-e25bd225bb0f admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.089620 Apr 11 16:59:08 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 16:59:08 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 16:59:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001985 Apr 11 16:59:10 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:59:10 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:59:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:59:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:59:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:59:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:59:10 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-aa8b6a1c-5ed0-4d74-ad36-1ebc58e07b6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-aa8b6a1c-5ed0-4d74-ad36-1ebc58e07b6a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.442405 Apr 11 16:59:10 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 16:59:10 2023] POST /compute/v2.1/flavors => generated 400 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:59:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-269b40d6-82cf-4540-9fe9-dc99e112cd0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-269b40d6-82cf-4540-9fe9-dc99e112cd0c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040276 Apr 11 16:59:10 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 16:59:10 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:59:12 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001503 Apr 11 16:59:12 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:59:12 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:59:12 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a8062a73-a40f-441e-9e3f-1933980a4fcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:12 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-a8062a73-a40f-441e-9e3f-1933980a4fcc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.057562 Apr 11 16:59:12 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 16:59:12 2023] POST /compute/v2.1/flavors => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:59:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2229f0c0-77fe-483f-96d2-a7b4971401f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-2229f0c0-77fe-483f-96d2-a7b4971401f2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038607 Apr 11 16:59:12 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 16:59:12 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:59:14 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:14 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001290 Apr 11 16:59:14 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:59:14 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:59:14 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e2629062-3b88-433e-ace3-9a5f0d58c801 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "disk": 40}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:14 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e2629062-3b88-433e-ace3-9a5f0d58c801 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.059972 Apr 11 16:59:14 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 16:59:14 2023] POST /compute/v2.1/flavors => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:59:14 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1c42ec0e-e4c3-4355-9ef3-8bcfca2fefbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:14 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-1c42ec0e-e4c3-4355-9ef3-8bcfca2fefbe admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026829 Apr 11 16:59:14 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 16:59:14 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:59:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001292 Apr 11 16:59:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:59:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:59:16 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-66c448ee-94a4-4440-9982-ebd474ed5e8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "swap": 0, "ram": 8192, "vcpus": 4}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:16 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-66c448ee-94a4-4440-9982-ebd474ed5e8a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062068 Apr 11 16:59:16 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 16:59:16 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:59:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3dbee324-8196-4ea6-9a99-13227c9e0491 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-3dbee324-8196-4ea6-9a99-13227c9e0491 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024854 Apr 11 16:59:16 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 16:59:16 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:59:18 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:18 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001326 Apr 11 16:59:18 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 16:59:18 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:59:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-4f17cdd7-8c18-454f-a3f5-a2d446b919df admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:18 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-4f17cdd7-8c18-454f-a3f5-a2d446b919df admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.108023 Apr 11 16:59:18 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 16:59:18 2023] POST /compute/v2.1/flavors => generated 406 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 16:59:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-85022aa8-31fb-441a-b1a1-fb572fa50dd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 16:59:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-85022aa8-31fb-441a-b1a1-fb572fa50dd0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025783 Apr 11 16:59:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 16:59:18 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 16:59:49 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:49 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-71ba79b0-95fc-49b1-aa72-c41aa55f2c66 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002196 Apr 11 16:59:49 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 16:59:49 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 16:59:49 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 16:59:49 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 16:59:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:59:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:59:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:59:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 16:59:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 16:59:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 16:59:49 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.157086 Apr 11 16:59:49 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 11 16:59:49 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:00:20 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-85022aa8-31fb-441a-b1a1-fb572fa50dd0 admin admin] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:00:20 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-85022aa8-31fb-441a-b1a1-fb572fa50dd0 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002417 Apr 11 17:00:20 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 17:00:20 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:00:21 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:00:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ae8a5b93-5fed-47f7-a3ea-3bd0a206f6bc admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:00:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ae8a5b93-5fed-47f7-a3ea-3bd0a206f6bc admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.065697 Apr 11 17:00:21 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 11 17:00:20 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:00:25 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:00:25 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002711 Apr 11 17:00:25 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 17:00:25 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:00:25 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:00:25 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-9219a559-1ec7-4e2f-b5e2-d50e34d6f4a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.nano", "ram": 128, "disk": 1, "id": "42", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:00:25 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-9219a559-1ec7-4e2f-b5e2-d50e34d6f4a2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.070861 Apr 11 17:00:25 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 17:00:25 2023] POST /compute/v2.1/flavors => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:00:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5e19eca0-9052-49b2-8bb9-62e3f5f9f9ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:00:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-5e19eca0-9052-49b2-8bb9-62e3f5f9f9ad admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025416 Apr 11 17:00:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 17:00:25 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:00:29 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:00:29 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-a400aaa4-b346-4ebd-8de9-138e9bfb199a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001446 Apr 11 17:00:29 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 17:00:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:00:29 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-e9072acb-47ba-4de0-8288-c576501468a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.micro", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 192, "id": "84", "swap": 0, "vcpus": 1}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:00:29 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-e9072acb-47ba-4de0-8288-c576501468a6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.064936 Apr 11 17:00:29 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 17:00:29 2023] POST /compute/v2.1/flavors => generated 404 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 17:00:30 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-10818a5f-ac21-4fbb-9114-5d65ab20adb7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:00:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-10818a5f-ac21-4fbb-9114-5d65ab20adb7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025968 Apr 11 17:00:30 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 17:00:30 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:02:55 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:02:55 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:02:55 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:02:55 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-3da5170e-cbe7-4919-8881-f0d489a4ed2f tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Action: 'create', calling method: .version_select at 0x7f5bde8c6200>, body: {"keypair": {"name": "tempest-keypair-1584212675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCL7i/fp+DnNA0UzB89OuJAWEkDI3RLIMqdCUH+lLMjesQHNn0HLcj03mslu5ZdYDA0lbw8n78DIaEgXcMzFJM3/kIURu2fRqfoahFiI9aLfMiPTgBrcusJmx/nC+OKLjg=="}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:02:55 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-3da5170e-cbe7-4919-8881-f0d489a4ed2f tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Getting quotas for project 9b803e7cf929440298b14cd3177c96e8. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:02:55 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-3da5170e-cbe7-4919-8881-f0d489a4ed2f tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Getting quotas for user c6126b468bd2414d831b105a3429ddd1 and project 9b803e7cf929440298b14cd3177c96e8. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:02:55 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-3da5170e-cbe7-4919-8881-f0d489a4ed2f tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.273845 Apr 11 17:02:55 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:02:55 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:02 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:02 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c609168e-5e02-4640-9b9c-f038dff49dec tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'create', calling method: .version_select at 0x7f5bde866710>, body: {"keypair": {"name": "tempest-keypair-1019962913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDp4PPID/sqhKcYHTiAEBEKPonJpCeicNP0uNCQWF5/mXkVJdRk2v0H1huInEZkdkgC7giKbq7OQQgxYStE3Sc0X3DqPcLJMEsajR3ktzXsDayGf8KA0cTxYvSO0lbY1Q=="}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:02 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-c609168e-5e02-4640-9b9c-f038dff49dec tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for project db242f5f39d94966948e8b487cd52d0c. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:02 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-c609168e-5e02-4640-9b9c-f038dff49dec tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for user 8f4ba7d7f3f74b5c800be2408c1035e2 and project db242f5f39d94966948e8b487cd52d0c. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:02 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c609168e-5e02-4640-9b9c-f038dff49dec tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.321425 Apr 11 17:03:02 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:03:02 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:02 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1332777263", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:03 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] validate_networks() for [('13083c72-58ed-4aa4-af8c-1e9f432f7f1c', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:03:05 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-296076626", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "fde90b2e-cb9a-41ba-a2ea-7c54065f557e"}], "security_groups": [{"name": "tempest-securitygroup--1653283046"}], "key_name": "tempest-keypair-1584212675", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:05 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting quotas for project 16e55c9209ac4b11b5af5ec1ad14d8b5. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting quotas for user 3666d19053684843b400aab6ebf29cce and project 16e55c9209ac4b11b5af5ec1ad14d8b5. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:03:05 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:03:05 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] validate_networks() for [('fde90b2e-cb9a-41ba-a2ea-7c54065f557e', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:03:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-069797b7-5abd-4afd-92b9-cdee912fcbd3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.932138 Apr 11 17:03:05 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:03:02 2023] POST /compute/v2.1/servers => generated 381 bytes in 2936 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:03:05 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-9a418078-f1ba-4586-913a-d9eff6a7fea1 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:05 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-9a418078-f1ba-4586-913a-d9eff6a7fea1 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:06 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-9a418078-f1ba-4586-913a-d9eff6a7fea1 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-9a418078-f1ba-4586-913a-d9eff6a7fea1 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c" status: 200 len: 1216 microversion: 2.1 time: 0.579876 Apr 11 17:03:06 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 18/49] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:03:05 2023] GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c => generated 1216 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:03:06 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1242455481", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:06 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] validate_networks() for [('13083c72-58ed-4aa4-af8c-1e9f432f7f1c', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Getting quotas for project 9b803e7cf929440298b14cd3177c96e8. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Getting quotas for user c6126b468bd2414d831b105a3429ddd1 and project 9b803e7cf929440298b14cd3177c96e8. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:03:07 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:03:07 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-8725c228-b70c-4779-b8b5-ebc6fb4cb421 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.249437 Apr 11 17:03:07 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 16/50] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:03:05 2023] POST /compute/v2.1/servers => generated 404 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:03:07 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-0d3c9775-bdb6-4f47-9342-bb3bb9310ba5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:07 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-0d3c9775-bdb6-4f47-9342-bb3bb9310ba5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:07 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0d3c9775-bdb6-4f47-9342-bb3bb9310ba5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6126b468bd2414d831b105a3429ddd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b803e7cf929440298b14cd3177c96e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-0d3c9775-bdb6-4f47-9342-bb3bb9310ba5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" status: 200 len: 1239 microversion: 2.1 time: 0.141696 Apr 11 17:03:07 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 19/51] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:03:07 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => generated 1239 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:03:08 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1483979995", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a3d41d47-6b37-4493-ac8f-572031c1a620"}], "security_groups": [{"name": "tempest-securitygroup--2090478013"}], "key_name": "tempest-keypair-1019962913", "user_data": "}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting quotas for project 16e55c9209ac4b11b5af5ec1ad14d8b5. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting quotas for user 3666d19053684843b400aab6ebf29cce and project 16e55c9209ac4b11b5af5ec1ad14d8b5. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:03:08 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:03:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-548874fa-73b5-43ff-a0e5-14e033c711ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.028234 Apr 11 17:03:08 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 17/52] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:03:06 2023] POST /compute/v2.1/servers => generated 381 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:03:08 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c7715271-7b9b-4f70-bc71-8a216a2215c4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:08 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c7715271-7b9b-4f70-bc71-8a216a2215c4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:08 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] validate_networks() for [('a3d41d47-6b37-4493-ac8f-572031c1a620', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:03:08 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-c7715271-7b9b-4f70-bc71-8a216a2215c4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:08 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c7715271-7b9b-4f70-bc71-8a216a2215c4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd" status: 200 len: 1216 microversion: 2.1 time: 0.173043 Apr 11 17:03:08 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 20/53] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:03:08 2023] GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:03:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1282492333", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "9c9850a3-bc74-40ff-896b-4fa8cb68b5cd"}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:09 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] validate_networks() for [('9c9850a3-bc74-40ff-896b-4fa8cb68b5cd', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:03:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-abcec8db-d853-46df-8804-a0b667eeacd6 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Action: 'create', calling method: .version_select at 0x7f5bde72a3b0>, body: {"keypair": {"name": "tempest-keypair-449429725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA5qpL0hWCB+gt6F3fvv5UvTqhnO9mUQvYRoBS0hUO2EshhZijfW1nG58h+a06TETr2dQ9dY7xDNY7Zv+ZQg8+hYW8PA5R8HvyHextAdgEri4OY6ZA3BmcUWhR7OdN8ww=="}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:10 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-abcec8db-d853-46df-8804-a0b667eeacd6 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting quotas for project 3c902eb30be24cc6bd26c0ab7036d037. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:10 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-abcec8db-d853-46df-8804-a0b667eeacd6 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting quotas for user ac0109eab2dc45fe824a03e2d09fa022 and project 3c902eb30be24cc6bd26c0ab7036d037. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-abcec8db-d853-46df-8804-a0b667eeacd6 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109441 Apr 11 17:03:10 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 21/54] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:03:09 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1883237379", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "f3262209-0a5c-4763-99ae-a8319122d98c"}]}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:10 user devstack@n-api.service[61424]: DEBUG nova.network.neutron [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] validate_networks() for [('f3262209-0a5c-4763-99ae-a8319122d98c', None, None, None, None, None)] {{(pid=61424) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for project db242f5f39d94966948e8b487cd52d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for user 8f4ba7d7f3f74b5c800be2408c1035e2 and project db242f5f39d94966948e8b487cd52d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:03:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:03:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-c6bce4f4-aea0-483e-a4bb-de9a6edfa8d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.871974 Apr 11 17:03:11 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 17/55] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:03:08 2023] POST /compute/v2.1/servers => generated 407 bytes in 2874 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:03:11 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-1b229ba9-a8eb-43f3-a47c-06294ffb2c0a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:11 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-1b229ba9-a8eb-43f3-a47c-06294ffb2c0a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:11 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-1b229ba9-a8eb-43f3-a47c-06294ffb2c0a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-1b229ba9-a8eb-43f3-a47c-06294ffb2c0a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1233 microversion: 2.1 time: 0.199626 Apr 11 17:03:11 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 18/56] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:03:11 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1233 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Getting quotas for project 9e0fe3df39a64a39934d199c01985777. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Getting quotas for user c74611f9b01a45ef8cfbb50fa9b06cc8 and project 9e0fe3df39a64a39934d199c01985777. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:03:11 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:03:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-a1827661-ddf6-4cc2-9047-a389ea5a114d tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.267851 Apr 11 17:03:11 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 18/57] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:03:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 2269 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:03:11 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b72528ff-68dc-4358-aeb9-a6d6883f8dd2 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:11 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-b72528ff-68dc-4358-aeb9-a6d6883f8dd2 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:12 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-b72528ff-68dc-4358-aeb9-a6d6883f8dd2 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74611f9b01a45ef8cfbb50fa9b06cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0fe3df39a64a39934d199c01985777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:12 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-b72528ff-68dc-4358-aeb9-a6d6883f8dd2 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41" status: 200 len: 1209 microversion: 2.1 time: 0.407698 Apr 11 17:03:12 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:03:11 2023] GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41 => generated 1209 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting quotas for project 361d59e2f9ac4a68a1a738cc3f2a9d14. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting quotas for user 79b5fefb1e9748b8bf51535099bf5327 and project 361d59e2f9ac4a68a1a738cc3f2a9d14. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Going to run 1 instances... {{(pid=61424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:03:13 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:03:13 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-a8b4dd02-a9ac-4f8c-bc79-a8276a9b65f4 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.737558 Apr 11 17:03:13 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 22/59] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 17:03:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 2739 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 17:03:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ada974a4-3e3b-4e7d-9bc8-afb74600c2bb tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:13 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ada974a4-3e3b-4e7d-9bc8-afb74600c2bb tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:13 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ada974a4-3e3b-4e7d-9bc8-afb74600c2bb tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:13 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ada974a4-3e3b-4e7d-9bc8-afb74600c2bb tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:13 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ada974a4-3e3b-4e7d-9bc8-afb74600c2bb tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ada974a4-3e3b-4e7d-9bc8-afb74600c2bb tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b" status: 200 len: 1395 microversion: 2.87 time: 0.214427 Apr 11 17:03:13 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 19/60] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:03:13 2023] GET /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b => generated 1395 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:03:17 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1659221805", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824"}], "security_groups": [{"name": "tempest-securitygroup--1531750676"}], "key_name": "tempest-keypair-449429725", "user_data": "}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58e3bca8-f38a-45d1-98c2-06391f9f31fd", "tag": "153bd902-5486-49d7-8f56-9ac648664124"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:17 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:18 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] Creating event network-changed:153bd902-5486-49d7-8f56-9ac648664124 for instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd on user Apr 11 17:03:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61422) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 17:03:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-4b71b510-855f-4c08-b52c-024a03e12749 req-03524a61-e7ce-45fa-ba80-0fabf095e0b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61422) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 17:03:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74dd66eb-2a1c-458e-9886-615c3f08f59e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74dd66eb-2a1c-458e-9886-615c3f08f59e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74dd66eb-2a1c-458e-9886-615c3f08f59e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74dd66eb-2a1c-458e-9886-615c3f08f59e None None] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74dd66eb-2a1c-458e-9886-615c3f08f59e None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74dd66eb-2a1c-458e-9886-615c3f08f59e None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:18 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] validate_networks() for [('6fe2f45e-c84e-4b74-af4a-118b0bfc9824', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:03:18 user devstack@n-api.service[61422]: INFO nova.compute.rpcapi [None req-74dd66eb-2a1c-458e-9886-615c3f08f59e None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 17:03:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74dd66eb-2a1c-458e-9886-615c3f08f59e None None] Releasing lock "compute-rpcapi-router" {{(pid=61422) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 17:03:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] Creating event network-changed:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:03:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61424) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 17:03:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-963ac9e5-9489-4a7c-8c00-833e014dabc1 req-2b329b0f-347c-409d-badd-c23f1793f94c service nova] Acquired lock "compute-rpcapi-router" {{(pid=61424) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 17:03:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b90aee2b-4d83-40f0-bae4-40b283a5cd9c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b90aee2b-4d83-40f0-bae4-40b283a5cd9c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b90aee2b-4d83-40f0-bae4-40b283a5cd9c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b90aee2b-4d83-40f0-bae4-40b283a5cd9c None None] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b90aee2b-4d83-40f0-bae4-40b283a5cd9c None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b90aee2b-4d83-40f0-bae4-40b283a5cd9c None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:18 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-74dd66eb-2a1c-458e-9886-615c3f08f59e None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145802 Apr 11 17:03:18 user devstack@n-api.service[61424]: INFO nova.compute.rpcapi [None req-b90aee2b-4d83-40f0-bae4-40b283a5cd9c None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 17:03:18 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 20/61] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b90aee2b-4d83-40f0-bae4-40b283a5cd9c None None] Releasing lock "compute-rpcapi-router" {{(pid=61424) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 17:03:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-b90aee2b-4d83-40f0-bae4-40b283a5cd9c None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166697 Apr 11 17:03:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 23/62] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:20 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] Creating event network-changed:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:03:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-17f529c9-6613-49f7-b2c4-c7379fe3089a req-0977f043-deff-4e6a-a957-cefab4be1074 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033349 Apr 11 17:03:20 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting quotas for project 3c902eb30be24cc6bd26c0ab7036d037. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting quotas for user ac0109eab2dc45fe824a03e2d09fa022 and project 3c902eb30be24cc6bd26c0ab7036d037. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:03:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-3e764f07-c33c-440d-9de9-4c39780c984d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.206968 Apr 11 17:03:20 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 20/64] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:03:17 2023] POST /compute/v2.1/servers => generated 400 bytes in 3208 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:03:20 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-b706322d-6668-44d3-81b4-2cbde110eff7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:20 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-b706322d-6668-44d3-81b4-2cbde110eff7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:20 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-b706322d-6668-44d3-81b4-2cbde110eff7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:20 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-b706322d-6668-44d3-81b4-2cbde110eff7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 200 len: 1231 microversion: 2.1 time: 0.178492 Apr 11 17:03:20 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 24/65] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:03:20 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 1231 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:03:20 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-75f11df3-5e5b-442b-befb-e9800379bca9 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Action: 'create', calling method: .version_select at 0x7f5bde7cb1c0>, body: {"keypair": {"name": "tempest-keypair-208324507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYkCAEQ+bl11uHPZVQKbgG6myknafTn09U4qfFdXo5BEH//wtE/q6s8OBga0Azbc9wMj6qkFejLKmdVWResnP4PMs0NtC25KI97YqzyPazY0r+rOz1TGx6RxCixovI8Ow=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:20 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-75f11df3-5e5b-442b-befb-e9800379bca9 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Getting quotas for project 7c7d76a8d4544e2b84d52eebb6d4b5b1. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:20 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-75f11df3-5e5b-442b-befb-e9800379bca9 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Getting quotas for user 1c4b1a17c7804cd4ba2ad825e0cc2dd0 and project 7c7d76a8d4544e2b84d52eebb6d4b5b1. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05988541-51cb-4e52-912e-ddf2b773db6b", "tag": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-75f11df3-5e5b-442b-befb-e9800379bca9 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.290409 Apr 11 17:03:20 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 22/66] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:03:20 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] Creating event network-changed:f4ebd413-5243-4c27-8dc3-91a5991d3ecf for instance 05988541-51cb-4e52-912e-ddf2b773db6b on user Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61423) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d3a71580-f457-4a97-9b5b-b93ccebf52f6 req-82c583fd-7bb5-4a4b-bbdc-77061e702c4e service nova] Acquired lock "compute-rpcapi-router" {{(pid=61423) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6ef67a09-6cf2-49f5-8d1b-3fe64898f968 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6ef67a09-6cf2-49f5-8d1b-3fe64898f968 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6ef67a09-6cf2-49f5-8d1b-3fe64898f968 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6ef67a09-6cf2-49f5-8d1b-3fe64898f968 None None] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6ef67a09-6cf2-49f5-8d1b-3fe64898f968 None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6ef67a09-6cf2-49f5-8d1b-3fe64898f968 None None] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:21 user devstack@n-api.service[61423]: INFO nova.compute.rpcapi [None req-6ef67a09-6cf2-49f5-8d1b-3fe64898f968 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 17:03:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6ef67a09-6cf2-49f5-8d1b-3fe64898f968 None None] Releasing lock "compute-rpcapi-router" {{(pid=61423) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 17:03:21 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-6ef67a09-6cf2-49f5-8d1b-3fe64898f968 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163694 Apr 11 17:03:21 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 21/67] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:03:22 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6687cdc1-6ab3-4e6d-b4a4-e03772606c41", "tag": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20"}, {"name": "network-changed", "server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Creating event network-changed:5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 for instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 on user Apr 11 17:03:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] Creating event network-changed:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:03:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-d96043a3-688a-42dc-8704-288ea1d71418 req-ba631aec-d7e4-4845-a8db-1b61b39da5b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.055989 Apr 11 17:03:22 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 25/68] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:22 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8c46bd32-b4c8-431c-98c2-8e6f6b97f5b9 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Action: 'create', calling method: .version_select at 0x7f5bde7cb640>, body: {"keypair": {"name": "tempest-keypair-1343943661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXQASF5POVSKT+6Cb9neB2DzmtcARSnrw7alBnxX24AHH7TdoZurn7Zjp47ozOOPlermL7JqhMAZ5O9u9neGe4Or35NaG0Z9zNUT9CetsumcUKjlTrO2prLN5MOqot/oQ=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:25 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-8c46bd32-b4c8-431c-98c2-8e6f6b97f5b9 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Getting quotas for project 381738c7ad99437b875807c4252965bf. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:25 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-8c46bd32-b4c8-431c-98c2-8e6f6b97f5b9 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Getting quotas for user d111d892e2944f279a36622978b2dd06 and project 381738c7ad99437b875807c4252965bf. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8c46bd32-b4c8-431c-98c2-8e6f6b97f5b9 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.240430 Apr 11 17:03:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 23/69] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:03:25 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:26 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:26 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=10 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-790493278", "imageRef": "c6bd1738-b766-4c42-8e29-ec27c8534889", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "ffb7e852-2910-4f4f-9c26-193dd9dc6bd6"}], "security_groups": [{"name": "tempest-securitygroup--2043563033"}], "key_name": "tempest-keypair-208324507", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:26 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] Creating event network-changed:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:03:26 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-ca354cce-fdf9-4ed6-bdbf-daacb88795cb req-36be2af9-34d1-4499-888d-e06bf17585d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046000 Apr 11 17:03:26 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 22/70] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:26 user devstack@n-api.service[61424]: DEBUG nova.network.neutron [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] validate_networks() for [('ffb7e852-2910-4f4f-9c26-193dd9dc6bd6', None, None, None, None, None)] {{(pid=61424) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Flavor limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Image limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Flavor pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Image pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=4 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Getting quotas for project 7c7d76a8d4544e2b84d52eebb6d4b5b1. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Getting quotas for user 1c4b1a17c7804cd4ba2ad825e0cc2dd0 and project 7c7d76a8d4544e2b84d52eebb6d4b5b1. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Going to run 1 instances... {{(pid=61424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c6bd1738-b766-4c42-8e29-ec27c8534889',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:03:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-e5127fe0-de1d-45bb-88a7-9c432633c764 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.755098 Apr 11 17:03:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 26/71] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:03:26 2023] POST /compute/v2.1/servers => generated 404 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:03:28 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=8 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a4c7967e-9858-4cae-8b30-cfaf0a3c8436 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:28 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a4c7967e-9858-4cae-8b30-cfaf0a3c8436 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:28 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-a4c7967e-9858-4cae-8b30-cfaf0a3c8436 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4b1a17c7804cd4ba2ad825e0cc2dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7d76a8d4544e2b84d52eebb6d4b5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-a4c7967e-9858-4cae-8b30-cfaf0a3c8436 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783" status: 200 len: 1238 microversion: 2.1 time: 0.103602 Apr 11 17:03:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 24/72] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:03:28 2023] GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783 => generated 1238 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:03:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e3bca8-f38a-45d1-98c2-06391f9f31fd", "name": "network-vif-plugged", "status": "completed", "tag": "153bd902-5486-49d7-8f56-9ac648664124"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] Creating event network-vif-plugged:153bd902-5486-49d7-8f56-9ac648664124 for instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd on user Apr 11 17:03:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-f2f8a6ca-7319-42f5-b44a-5e48679f20f2 req-4e0907a1-8bcc-4c0c-8bb3-292f9cb91cec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067828 Apr 11 17:03:28 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 23/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05988541-51cb-4e52-912e-ddf2b773db6b", "name": "network-vif-plugged", "status": "completed", "tag": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] Creating event network-vif-plugged:f4ebd413-5243-4c27-8dc3-91a5991d3ecf for instance 05988541-51cb-4e52-912e-ddf2b773db6b on user Apr 11 17:03:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-7ae4a56b-18fc-483f-90db-0228af046fca req-6ad8862d-c67c-4efc-ab6c-2cf5ae65daac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046922 Apr 11 17:03:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 27/74] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-758752172", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "3d6cedad-ded5-40a1-b6c1-beeb84619510"}], "security_groups": [{"name": "tempest-securitygroup--826622549"}], "key_name": "tempest-keypair-1343943661", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:29 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] validate_networks() for [('3d6cedad-ded5-40a1-b6c1-beeb84619510', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:03:29 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-plugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:29 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] Creating event network-vif-plugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:03:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-bb10ba37-38f2-43ab-9c76-068b4a52d085 req-2e72c570-a325-4169-98d1-29e336d2f7b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036438 Apr 11 17:03:30 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 24/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=12 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Getting quotas for project 381738c7ad99437b875807c4252965bf. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Getting quotas for user d111d892e2944f279a36622978b2dd06 and project 381738c7ad99437b875807c4252965bf. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:03:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-4d0cea8f-86c0-4577-909c-99c756ef9d89 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.739060 Apr 11 17:03:30 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 25/76] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:03:29 2023] POST /compute/v2.1/servers => generated 403 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:03:30 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-99cdf4e4-eb2f-4378-b2b2-53e86b564bcb tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:30 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-99cdf4e4-eb2f-4378-b2b2-53e86b564bcb tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:30 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-99cdf4e4-eb2f-4378-b2b2-53e86b564bcb tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd111d892e2944f279a36622978b2dd06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381738c7ad99437b875807c4252965bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-7c49cdc4-4ac8-470d-8e5d-3c1034b37708 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Action: 'create', calling method: .version_select at 0x7f5bde611990>, body: {"keypair": {"name": "tempest-keypair-527051490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwQqBR25F/d8+YQpxEvpMHcmc9ai8/bmMyB08gTAOS/9e0+ptL1kApIgEHLD2wpbxwJv/e1PvASxFkuguZZmHUsixgqr0BQkG9MSSBFMuViP9XL3XIwb0RQ4dQ2b71JAw=="}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:30 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-99cdf4e4-eb2f-4378-b2b2-53e86b564bcb tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" status: 200 len: 1235 microversion: 2.1 time: 0.107765 Apr 11 17:03:30 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 28/77] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:03:30 2023] GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e => generated 1235 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:03:30 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=22 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:30 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-7c49cdc4-4ac8-470d-8e5d-3c1034b37708 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Getting quotas for project 9791f1371ba74005a40cd51a63d63c94. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:30 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-7c49cdc4-4ac8-470d-8e5d-3c1034b37708 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Getting quotas for user f20dcfb0f94c419b9111571e89bc3aa4 and project 9791f1371ba74005a40cd51a63d63c94. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e3bca8-f38a-45d1-98c2-06391f9f31fd", "name": "network-vif-plugged", "status": "completed", "tag": "153bd902-5486-49d7-8f56-9ac648664124"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-7c49cdc4-4ac8-470d-8e5d-3c1034b37708 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135176 Apr 11 17:03:30 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 25/78] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:03:30 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] Creating event network-vif-plugged:153bd902-5486-49d7-8f56-9ac648664124 for instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd on user Apr 11 17:03:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-8d7d5652-eec8-4d7d-ae27-73a114a073a4 req-5e1afe2e-36e6-4e44-803b-12848ed953c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069650 Apr 11 17:03:30 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 26/79] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:03:30 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05988541-51cb-4e52-912e-ddf2b773db6b", "name": "network-vif-plugged", "status": "completed", "tag": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf"}, {"server_uuid": "6687cdc1-6ab3-4e6d-b4a4-e03772606c41", "name": "network-vif-plugged", "status": "completed", "tag": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20"}, {"server_uuid": "6687cdc1-6ab3-4e6d-b4a4-e03772606c41", "name": "network-vif-plugged", "status": "completed", "tag": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:30 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Creating event network-vif-plugged:f4ebd413-5243-4c27-8dc3-91a5991d3ecf for instance 05988541-51cb-4e52-912e-ddf2b773db6b on user Apr 11 17:03:30 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Creating event network-vif-plugged:5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 for instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 on user Apr 11 17:03:30 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] Creating event network-vif-plugged:5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 for instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 on user Apr 11 17:03:30 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-adc68e5d-2330-4254-8c56-4f0da58ef59f req-e54314f1-80b0-4ae3-a8c4-f3c8da15f567 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.105755 Apr 11 17:03:30 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 29/80] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:30 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:32 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-plugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}, {"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-plugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:32 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:32 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Creating event network-vif-plugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:03:32 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] Creating event network-vif-plugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:03:32 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-f9e8a97f-00b1-4deb-a918-5b2e49661816 req-e54a6fc7-2737-473f-b917-efcc6eacb3da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.324278 Apr 11 17:03:32 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 26/81] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:34 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-plugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] Creating event network-vif-plugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:03:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-d85996a3-ec87-4afa-b65c-10104059e7d1 req-855a8fe8-ee88-49f1-8b2d-fade0e288663 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136429 Apr 11 17:03:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:34 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1632556398", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "3f167744-bc75-4e0f-8b4e-c56a4899c588"}], "security_groups": [{"name": "tempest-securitygroup--2085280988"}], "key_name": "tempest-keypair-527051490", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:34 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=8 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:35 user devstack@n-api.service[61424]: DEBUG nova.network.neutron [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] validate_networks() for [('3f167744-bc75-4e0f-8b4e-c56a4899c588', None, None, None, None, None)] {{(pid=61424) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:03:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:35 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=19 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:35 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:03:35 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-7817c7cf-138f-4722-8c64-df541471a33d req-fd19e5dc-4266-4345-be63-1129ef317f67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095349 Apr 11 17:03:35 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 27/83] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:36 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:03:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-f7ccdd15-5afe-46fd-b6c6-9558e36e5e40 req-554ba2d7-f3a5-4546-b878-06317ceb85e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056978 Apr 11 17:03:36 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}, {"name": "network-changed", "server_uuid": "cdd4a3a0-35a6-4f62-abc1-6a806ab62783", "tag": "c93de33f-8a35-40fb-bb48-f717e6fb90f6"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:38 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:03:38 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] Creating event network-changed:c93de33f-8a35-40fb-bb48-f717e6fb90f6 for instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 on user Apr 11 17:03:38 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-13ea7f1f-7afd-466d-b568-57eefdd848d9 req-7388c70b-1739-4c88-9e26-8b354ed2e5ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.063302 Apr 11 17:03:38 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 28/85] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:37 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:38 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:39 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Flavor limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Image limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Flavor pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Image pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:03:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=31 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-64003f52-5286-4cb7-a177-f37a81bf7a5d req-4838da80-81b3-4ab2-a291-b1a1b5613073 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099178 Apr 11 17:03:39 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Getting quotas for project 9791f1371ba74005a40cd51a63d63c94. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Getting quotas for user f20dcfb0f94c419b9111571e89bc3aa4 and project 9791f1371ba74005a40cd51a63d63c94. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Going to run 1 instances... {{(pid=61424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:03:39 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:03:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-44c77775-ee92-4c3f-9fbe-8112d5c6dc8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 4.820201 Apr 11 17:03:39 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 30/87] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:03:34 2023] POST /compute/v2.1/servers => generated 404 bytes in 4823 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:03:39 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-db92401e-9b87-474b-ada2-6e6393fc8685 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:39 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-db92401e-9b87-474b-ada2-6e6393fc8685 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:40 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-db92401e-9b87-474b-ada2-6e6393fc8685 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20dcfb0f94c419b9111571e89bc3aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9791f1371ba74005a40cd51a63d63c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:40 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-db92401e-9b87-474b-ada2-6e6393fc8685 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404" status: 200 len: 1225 microversion: 2.1 time: 0.283295 Apr 11 17:03:40 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 29/88] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:03:39 2023] GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404 => generated 1225 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:03:41 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:41 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=36 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd4a3a0-35a6-4f62-abc1-6a806ab62783", "name": "network-vif-plugged", "status": "completed", "tag": "c93de33f-8a35-40fb-bb48-f717e6fb90f6"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] Creating event network-vif-plugged:c93de33f-8a35-40fb-bb48-f717e6fb90f6 for instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 on user Apr 11 17:03:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5261d3d4-bbad-4739-8522-b1eb11bdf3af req-1ca2a70e-ff1d-44f6-89ad-dcb1d61ee326 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056892 Apr 11 17:03:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:43 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd4a3a0-35a6-4f62-abc1-6a806ab62783", "name": "network-vif-plugged", "status": "completed", "tag": "c93de33f-8a35-40fb-bb48-f717e6fb90f6"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:43 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=17 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:43 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] Creating event network-vif-plugged:c93de33f-8a35-40fb-bb48-f717e6fb90f6 for instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 on user Apr 11 17:03:43 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-6f1b05f3-ba89-4572-97c5-29963a9df929 req-925646cf-c5c1-47b0-a23c-91e887122e8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183234 Apr 11 17:03:43 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 31/90] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:43 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e", "tag": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] Creating event network-changed:68bea989-7c25-4d4d-aa6d-e4fe977ebb93 for instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e on user Apr 11 17:03:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-639fa9d6-eb40-44da-8755-deb9d5c91b09 req-c2c4db2c-cee1-4d1b-839f-6da9e46b234e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185889 Apr 11 17:03:43 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 30/91] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:46 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180c44cc-172d-4e8c-b4ec-6259e775c404", "tag": "3bc601e8-552e-473e-abe3-24e32a78188f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:46 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] Creating event network-changed:3bc601e8-552e-473e-abe3-24e32a78188f for instance 180c44cc-172d-4e8c-b4ec-6259e775c404 on user Apr 11 17:03:46 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-43c1929f-1d03-4337-a528-eec37e159515 req-81e44689-9b9f-4582-9b32-8e9663658346 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078256 Apr 11 17:03:46 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 31/92] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:48 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e", "name": "network-vif-plugged", "status": "completed", "tag": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:48 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] Creating event network-vif-plugged:68bea989-7c25-4d4d-aa6d-e4fe977ebb93 for instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e on user Apr 11 17:03:48 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-f78647a8-ffc8-4572-8bc4-946563056595 req-970ceda4-484a-44fe-855a-872abaab06ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048301 Apr 11 17:03:48 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 32/93] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:50 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:50 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e", "name": "network-vif-plugged", "status": "completed", "tag": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93"}, {"server_uuid": "180c44cc-172d-4e8c-b4ec-6259e775c404", "name": "network-vif-plugged", "status": "completed", "tag": "3bc601e8-552e-473e-abe3-24e32a78188f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:50 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Creating event network-vif-plugged:68bea989-7c25-4d4d-aa6d-e4fe977ebb93 for instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e on user Apr 11 17:03:50 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] Creating event network-vif-plugged:3bc601e8-552e-473e-abe3-24e32a78188f for instance 180c44cc-172d-4e8c-b4ec-6259e775c404 on user Apr 11 17:03:50 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-c514d5c7-e177-48a4-9ed5-4280fa68aa08 req-e43133b5-75e7-4841-85e6-3406d7754518 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073563 Apr 11 17:03:50 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:52 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180c44cc-172d-4e8c-b4ec-6259e775c404", "name": "network-vif-plugged", "status": "completed", "tag": "3bc601e8-552e-473e-abe3-24e32a78188f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:03:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] Creating event network-vif-plugged:3bc601e8-552e-473e-abe3-24e32a78188f for instance 180c44cc-172d-4e8c-b4ec-6259e775c404 on user Apr 11 17:03:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-acad8e9b-a72c-4e09-bd74-520c8fa1249a req-b3cb1640-9981-4f8b-8a57-85d827535f4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032591 Apr 11 17:03:52 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 32/95] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:03:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:03:57 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:57 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=5 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:57 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-8c450527-eee7-4711-944b-c056de95d2ce tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:57 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-8c450527-eee7-4711-944b-c056de95d2ce tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8c450527-eee7-4711-944b-c056de95d2ce tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8c450527-eee7-4711-944b-c056de95d2ce tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8c450527-eee7-4711-944b-c056de95d2ce tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8c450527-eee7-4711-944b-c056de95d2ce tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8c450527-eee7-4711-944b-c056de95d2ce tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8c450527-eee7-4711-944b-c056de95d2ce tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:58 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-8c450527-eee7-4711-944b-c056de95d2ce tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6126b468bd2414d831b105a3429ddd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b803e7cf929440298b14cd3177c96e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:58 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-8c450527-eee7-4711-944b-c056de95d2ce tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" status: 200 len: 1553 microversion: 2.1 time: 0.953733 Apr 11 17:03:58 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 33/96] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:03:57 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => generated 1553 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:03:58 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-437f239f-074f-43a0-b264-dc43a4270433 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:03:58 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-437f239f-074f-43a0-b264-dc43a4270433 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:03:58 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:03:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-437f239f-074f-43a0-b264-dc43a4270433 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-437f239f-074f-43a0-b264-dc43a4270433 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-437f239f-074f-43a0-b264-dc43a4270433 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-437f239f-074f-43a0-b264-dc43a4270433 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:03:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-437f239f-074f-43a0-b264-dc43a4270433 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:03:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-437f239f-074f-43a0-b264-dc43a4270433 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:03:58 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-437f239f-074f-43a0-b264-dc43a4270433 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:03:59 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-437f239f-074f-43a0-b264-dc43a4270433 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd" status: 200 len: 1505 microversion: 2.1 time: 0.371291 Apr 11 17:03:59 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 32/97] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:03:58 2023] GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:04:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9cb61499-61a0-47f5-862c-668c7e5ba945 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:01 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9cb61499-61a0-47f5-862c-668c7e5ba945 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:01 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9cb61499-61a0-47f5-862c-668c7e5ba945 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9cb61499-61a0-47f5-862c-668c7e5ba945 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9cb61499-61a0-47f5-862c-668c7e5ba945 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9cb61499-61a0-47f5-862c-668c7e5ba945 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9cb61499-61a0-47f5-862c-668c7e5ba945 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9cb61499-61a0-47f5-862c-668c7e5ba945 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:01 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=17 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:01 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-9cb61499-61a0-47f5-862c-668c7e5ba945 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9cb61499-61a0-47f5-862c-668c7e5ba945 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1540 microversion: 2.1 time: 0.466808 Apr 11 17:04:01 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 33/98] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:04:01 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1540 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:04:02 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-a5e7ab94-2538-4335-867f-023f793ae92c tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:02 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-a5e7ab94-2538-4335-867f-023f793ae92c tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a5e7ab94-2538-4335-867f-023f793ae92c tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a5e7ab94-2538-4335-867f-023f793ae92c tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a5e7ab94-2538-4335-867f-023f793ae92c tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a5e7ab94-2538-4335-867f-023f793ae92c tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a5e7ab94-2538-4335-867f-023f793ae92c tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a5e7ab94-2538-4335-867f-023f793ae92c tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:02 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-a5e7ab94-2538-4335-867f-023f793ae92c tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74611f9b01a45ef8cfbb50fa9b06cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0fe3df39a64a39934d199c01985777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:02 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-a5e7ab94-2538-4335-867f-023f793ae92c tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41" status: 200 len: 1491 microversion: 2.1 time: 0.171659 Apr 11 17:04:02 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 34/99] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:04:02 2023] GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41 => generated 1491 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:04:03 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:03 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:03 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:03 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:03 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:03 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-5509cee8-a94e-4d8f-9555-30dd3148c416 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b" status: 200 len: 1691 microversion: 2.87 time: 0.297551 Apr 11 17:04:03 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 33/100] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:04:03 2023] GET /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b => generated 1691 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:04:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e6f37878-8f8c-4511-8184-4cec3ba7a6cb tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Action: 'create', calling method: .version_select at 0x7f5bdde06950>, body: {"keypair": {"name": "tempest-keypair-2087464564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/5jm1fKXCP1YAn+tuRzzy+VuLKNRDw8nvrxrroW0IXHxPLaVSV0dmxnta8h4tLPexZZFGWUyjyDcKlUzf6WbnDDy+r4Yl2/yzJQ+j2EM9v1lA0dmxM1HGw0TjJsYS+Tg=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:04 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-e6f37878-8f8c-4511-8184-4cec3ba7a6cb tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Getting quotas for project 6c144e1059e44b55bb7aa451b9547a75. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:04:04 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-e6f37878-8f8c-4511-8184-4cec3ba7a6cb tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Getting quotas for user b2f35f746a2c41828b209a93f555993c and project 6c144e1059e44b55bb7aa451b9547a75. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:04:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e6f37878-8f8c-4511-8184-4cec3ba7a6cb tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.082954 Apr 11 17:04:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 34/101] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 17:04:04 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 17:04:05 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-fc9d10cc-f05f-4b68-8dfb-7813d99f4c4c tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Action: 'create', calling method: .version_select at 0x7f5bdde16830>, body: {"keypair": {"name": "tempest-keypair-79124000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyGFDbhVDGCKSiWGnoV6tVcUjkniWnqhXWUKiVa5Ff7PKJjHyU83wnMe2hXpM2dluoDuVji+joNFeyHoixY16dvL/vDLMLbjMXWVRg8Q7lMSaJOSU07AZ+3ehtOjjiljw=="}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:05 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:05 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-fc9d10cc-f05f-4b68-8dfb-7813d99f4c4c tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Getting quotas for project d5ab1632b5534eb9b5096d25137bd538. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:04:05 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-fc9d10cc-f05f-4b68-8dfb-7813d99f4c4c tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Getting quotas for user 9fda97057cf6440f8a117c8a01cde53a and project d5ab1632b5534eb9b5096d25137bd538. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:04:05 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-fc9d10cc-f05f-4b68-8dfb-7813d99f4c4c tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.32 time: 0.086867 Apr 11 17:04:05 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 35/102] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 17:04:05 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 89 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 17:04:06 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-956152073", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "15ad4720-343d-4440-b8ea-91b96b18416d"}, {"port": "f73daf99-e281-41dc-87d9-f257045a8146", "tag": "port-1"}, {"port": "0affebd5-561c-497c-9491-338dce8905e9", "tag": "port-2"}, {"uuid": "c5829f77-113b-4bfb-b286-e761e95a882b", "tag": "net-1"}, {"uuid": "c5829f77-113b-4bfb-b286-e761e95a882b"}, {"uuid": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b0019c18-8ef1-4bfd-8bd9-832a0aa82609", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ef3cc231-2504-4ee1-a0e8-daabd3795b23", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a7454087-e7d4-4c56-a159-187cdd2dc184", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b187ea12-9922-4398-a612-60259900feee", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1463691300"}], "key_name": "tempest-keypair-2087464564", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:06 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-457045036", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "ec3dc14b-bb3d-476c-b632-ad7601808691"}, {"port": "a4c6824f-e5f7-4f25-81eb-5cc534c99636", "tag": "port-1"}, {"port": "818fbdc6-1f85-4f25-a9a8-99aec719102e", "tag": "port-2"}, {"uuid": "51ac13fa-7a9c-45dd-9dd2-6b318da34392", "tag": "net-1"}, {"uuid": "51ac13fa-7a9c-45dd-9dd2-6b318da34392"}, {"uuid": "4fbddf17-0174-4597-94a8-1fb272515673", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4fbddf17-0174-4597-94a8-1fb272515673", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d307a14d-98e3-406f-baef-24e6a61dc887", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a309ad9f-380c-4dda-83e1-7f5f0acf75b3", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "498b42b1-60cf-4372-a5cf-6cdea4caded0", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--771382602"}], "key_name": "tempest-keypair-79124000", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:07 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] validate_networks() for [('15ad4720-343d-4440-b8ea-91b96b18416d', None, None, None, None, None), (None, None, 'f73daf99-e281-41dc-87d9-f257045a8146', None, None, None), (None, None, '0affebd5-561c-497c-9491-338dce8905e9', None, None, None), ('c5829f77-113b-4bfb-b286-e761e95a882b', None, None, None, None, None), ('c5829f77-113b-4bfb-b286-e761e95a882b', None, None, None, None, None), ('b0019c18-8ef1-4bfd-8bd9-832a0aa82609', '10.2.2.100', None, None, None, None), ('b0019c18-8ef1-4bfd-8bd9-832a0aa82609', '10.2.2.200', None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:04:07 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] validate_networks() for [('ec3dc14b-bb3d-476c-b632-ad7601808691', None, None, None, None, None), (None, None, 'a4c6824f-e5f7-4f25-81eb-5cc534c99636', None, None, None), (None, None, '818fbdc6-1f85-4f25-a9a8-99aec719102e', None, None, None), ('51ac13fa-7a9c-45dd-9dd2-6b318da34392', None, None, None, None, None), ('51ac13fa-7a9c-45dd-9dd2-6b318da34392', None, None, None, None, None), ('4fbddf17-0174-4597-94a8-1fb272515673', '10.2.2.100', None, None, None, None), ('4fbddf17-0174-4597-94a8-1fb272515673', '10.2.2.200', None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Getting quotas for project d5ab1632b5534eb9b5096d25137bd538. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Getting quotas for user 9fda97057cf6440f8a117c8a01cde53a and project d5ab1632b5534eb9b5096d25137bd538. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:04:09 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d307a14d-98e3-406f-baef-24e6a61dc887',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a309ad9f-380c-4dda-83e1-7f5f0acf75b3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='498b42b1-60cf-4372-a5cf-6cdea4caded0',volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:04:09 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-93766666-fe28-4a99-b0e1-c077ffbe9249 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Action: 'create', calling method: .version_select at 0x7f5bddeacd30>, body: {"keypair": {"name": "tempest-TestStampPattern-1509466846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqVHJjlSMe35tw2qPnj2PHHjKX4ymJut8zQ3I88KU88GUzP79oLtOHHH3V2Cu2oBSFCgADj8OVnlXj1Gno9O82Gz9f3XFf+zIYwDolvuEskjknTqJeB7hEyJu1K/AKDbA=="}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:09 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-93766666-fe28-4a99-b0e1-c077ffbe9249 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Getting quotas for project ec4085a617084465ae810ff06498f992. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:04:09 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-93766666-fe28-4a99-b0e1-c077ffbe9249 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Getting quotas for user 1f7d3b94cc6b4a7d95489d7d4cf6e297 and project ec4085a617084465ae810ff06498f992. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:04:09 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-93766666-fe28-4a99-b0e1-c077ffbe9249 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.237484 Apr 11 17:04:09 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 36/103] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:04:09 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-04dd5fa4-8143-4476-9ee2-6d88682e3de5 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 2.936033 Apr 11 17:04:09 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 35/104] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 17:04:06 2023] POST /compute/v2.1/servers => generated 403 bytes in 2938 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 17:04:09 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-943b31a0-4f20-4859-b43c-4194e75da7e1 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:09 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-943b31a0-4f20-4859-b43c-4194e75da7e1 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:09 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-943b31a0-4f20-4859-b43c-4194e75da7e1 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:09 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=20 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:09 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-943b31a0-4f20-4859-b43c-4194e75da7e1 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:09 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-943b31a0-4f20-4859-b43c-4194e75da7e1 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:09 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-943b31a0-4f20-4859-b43c-4194e75da7e1 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee" status: 200 len: 1277 microversion: 2.32 time: 0.078767 Apr 11 17:04:09 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 37/105] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:04:09 2023] GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee => generated 1277 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:04:10 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Getting quotas for project 6c144e1059e44b55bb7aa451b9547a75. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:04:10 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Getting quotas for user b2f35f746a2c41828b209a93f555993c and project 6c144e1059e44b55bb7aa451b9547a75. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:04:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:04:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ef3cc231-2504-4ee1-a0e8-daabd3795b23',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a7454087-e7d4-4c56-a159-187cdd2dc184',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b187ea12-9922-4398-a612-60259900feee',volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:04:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-3a435710-a0c6-4001-a1ef-fc9a8724ccd9 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.823872 Apr 11 17:04:10 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 34/106] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 17:04:06 2023] POST /compute/v2.1/servers => generated 404 bytes in 3825 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 17:04:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-43140d08-2e35-424e-9bef-6d2fe45524c2 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:10 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-43140d08-2e35-424e-9bef-6d2fe45524c2 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:10 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-43140d08-2e35-424e-9bef-6d2fe45524c2 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:10 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-43140d08-2e35-424e-9bef-6d2fe45524c2 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:10 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-43140d08-2e35-424e-9bef-6d2fe45524c2 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-43140d08-2e35-424e-9bef-6d2fe45524c2 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" status: 200 len: 1279 microversion: 2.42 time: 0.084775 Apr 11 17:04:10 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 36/107] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:04:10 2023] GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:04:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-9363d007-b94e-472d-b2d9-5b331eab7b83 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:10 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-9363d007-b94e-472d-b2d9-5b331eab7b83 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9363d007-b94e-472d-b2d9-5b331eab7b83 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9363d007-b94e-472d-b2d9-5b331eab7b83 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9363d007-b94e-472d-b2d9-5b331eab7b83 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9363d007-b94e-472d-b2d9-5b331eab7b83 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9363d007-b94e-472d-b2d9-5b331eab7b83 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9363d007-b94e-472d-b2d9-5b331eab7b83 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:11 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-9363d007-b94e-472d-b2d9-5b331eab7b83 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-9363d007-b94e-472d-b2d9-5b331eab7b83 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 200 len: 1538 microversion: 2.1 time: 0.227434 Apr 11 17:04:11 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 38/108] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:04:10 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 1538 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:04:12 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-2117639307", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1509466846", "security_groups": [{"name": "tempest-secgroup-smoke-1624742076"}], "networks": [{"uuid": "bdb09d43-70cb-4856-948c-4e13c107fac8"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:12 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] validate_networks() for [('bdb09d43-70cb-4856-948c-4e13c107fac8', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Getting quotas for project ec4085a617084465ae810ff06498f992. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Getting quotas for user 1f7d3b94cc6b4a7d95489d7d4cf6e297 and project ec4085a617084465ae810ff06498f992. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:04:13 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:04:13 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-0a3588a6-8c43-49ff-b568-d0a50af22cb9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.767329 Apr 11 17:04:13 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 35/109] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:04:12 2023] POST /compute/v2.1/servers => generated 404 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:04:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-0bed6e42-d3e2-4aae-a07b-dba5d4f94053 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:13 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-0bed6e42-d3e2-4aae-a07b-dba5d4f94053 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:13 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-0bed6e42-d3e2-4aae-a07b-dba5d4f94053 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f7d3b94cc6b4a7d95489d7d4cf6e297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4085a617084465ae810ff06498f992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-0bed6e42-d3e2-4aae-a07b-dba5d4f94053 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790" status: 200 len: 1237 microversion: 2.1 time: 0.127697 Apr 11 17:04:13 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 37/110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:04:13 2023] GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790 => generated 1237 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:04:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "tag": "7320c7cb-cd67-4b96-bcd0-865515f9b472"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:16 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=22 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] Creating event network-changed:7320c7cb-cd67-4b96-bcd0-865515f9b472 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-4adc21df-3ecb-4cd7-9f36-92dedb72ec46 req-94e56545-2b89-4422-adcc-64eb19ecc71a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040898 Apr 11 17:04:16 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 39/111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:16 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9339e177-6264-4942-9dd1-372681209790", "tag": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:17 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] Creating event network-changed:dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance 9339e177-6264-4942-9dd1-372681209790 on user Apr 11 17:04:17 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-0863d194-7348-4092-b15a-0f7b78359f54 req-be118491-a854-406a-855b-f41cd2fe81bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040908 Apr 11 17:04:17 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 36/112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "tag": "dfdf099d-908f-40d1-937c-cfa70a5b38b5"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] Creating event network-changed:dfdf099d-908f-40d1-937c-cfa70a5b38b5 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-9de7cfc0-bd86-49fc-8520-f127c7903eea req-5e59df7e-1aa0-4801-b0ab-14ed94157a4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043557 Apr 11 17:04:17 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 38/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "tag": "a4c6824f-e5f7-4f25-81eb-5cc534c99636"}, {"name": "network-changed", "server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "tag": "818fbdc6-1f85-4f25-a9a8-99aec719102e"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Creating event network-changed:a4c6824f-e5f7-4f25-81eb-5cc534c99636 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] Creating event network-changed:818fbdc6-1f85-4f25-a9a8-99aec719102e for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-7d5c37f2-0306-443c-949b-04b7d93a4619 req-e3540494-9e1d-4b80-a5b0-35938d57d446 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031799 Apr 11 17:04:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 40/114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:18 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2220a2d4-c6e5-4e5b-8540-2c5bd8cd1214 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:18 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2220a2d4-c6e5-4e5b-8540-2c5bd8cd1214 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2220a2d4-c6e5-4e5b-8540-2c5bd8cd1214 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2220a2d4-c6e5-4e5b-8540-2c5bd8cd1214 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2220a2d4-c6e5-4e5b-8540-2c5bd8cd1214 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2220a2d4-c6e5-4e5b-8540-2c5bd8cd1214 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2220a2d4-c6e5-4e5b-8540-2c5bd8cd1214 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2220a2d4-c6e5-4e5b-8540-2c5bd8cd1214 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:18 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-2220a2d4-c6e5-4e5b-8540-2c5bd8cd1214 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4b1a17c7804cd4ba2ad825e0cc2dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7d76a8d4544e2b84d52eebb6d4b5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:18 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2220a2d4-c6e5-4e5b-8540-2c5bd8cd1214 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783" status: 200 len: 1547 microversion: 2.1 time: 0.332911 Apr 11 17:04:18 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 37/115] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:04:18 2023] GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783 => generated 1547 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:04:19 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9339e177-6264-4942-9dd1-372681209790", "name": "network-vif-plugged", "status": "completed", "tag": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] Creating event network-vif-plugged:dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance 9339e177-6264-4942-9dd1-372681209790 on user Apr 11 17:04:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-daa1422e-5de3-43ff-8504-c8c5b2128122 req-3a02d003-d23e-4f7e-b117-fa612db9ad72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052165 Apr 11 17:04:19 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 39/116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:19 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "tag": "f73daf99-e281-41dc-87d9-f257045a8146"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:19 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] Creating event network-changed:f73daf99-e281-41dc-87d9-f257045a8146 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:19 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-c623da5d-d866-419c-8467-fab84a6f6a0a req-b1283bfd-9825-456f-9943-66c8e655af98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072634 Apr 11 17:04:19 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 41/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:20 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "tag": "c6dc07d2-c1e5-44f7-8683-0162519e8613"}, {"name": "network-changed", "server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "tag": "8a27e645-0909-4786-a624-5d12630f2e1b"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Creating event network-changed:c6dc07d2-c1e5-44f7-8683-0162519e8613 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] Creating event network-changed:8a27e645-0909-4786-a624-5d12630f2e1b for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-439fd3e5-5522-400d-9bf8-bb31738662e6 req-f8d4fde1-7ed1-402e-a044-cb2324059ee0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037896 Apr 11 17:04:20 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 38/118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:20 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:20 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:20 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-eed678d9-756e-449d-81db-421f10e9a32c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:20 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-eed678d9-756e-449d-81db-421f10e9a32c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eed678d9-756e-449d-81db-421f10e9a32c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eed678d9-756e-449d-81db-421f10e9a32c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eed678d9-756e-449d-81db-421f10e9a32c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eed678d9-756e-449d-81db-421f10e9a32c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eed678d9-756e-449d-81db-421f10e9a32c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eed678d9-756e-449d-81db-421f10e9a32c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:20 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-eed678d9-756e-449d-81db-421f10e9a32c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd111d892e2944f279a36622978b2dd06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381738c7ad99437b875807c4252965bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-eed678d9-756e-449d-81db-421f10e9a32c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" status: 200 len: 1544 microversion: 2.1 time: 0.281324 Apr 11 17:04:20 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 40/119] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:04:20 2023] GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e => generated 1544 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:04:21 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=10 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:21 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9339e177-6264-4942-9dd1-372681209790", "name": "network-vif-plugged", "status": "completed", "tag": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:21 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] Creating event network-vif-plugged:dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance 9339e177-6264-4942-9dd1-372681209790 on user Apr 11 17:04:21 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-b1e6c5f4-73ea-4b89-88c3-4568bedc9d09 req-1589694d-04c0-44ed-9750-50946b0b6052 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053775 Apr 11 17:04:21 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 42/120] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:21 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "tag": "0affebd5-561c-497c-9491-338dce8905e9"}, {"name": "network-changed", "server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "tag": "84d3c99c-9ae0-4d15-8338-ece1d9a04125"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:21 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Creating event network-changed:0affebd5-561c-497c-9491-338dce8905e9 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:21 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] Creating event network-changed:84d3c99c-9ae0-4d15-8338-ece1d9a04125 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:21 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-989830ce-9143-4176-a750-8110ce3ee81d req-0963c039-d921-43b6-bda2-22375910dd54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041829 Apr 11 17:04:21 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 39/121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:21 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:22 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "tag": "99ac8a24-e783-4834-a419-d58b3e288aa4"}, {"name": "network-changed", "server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "tag": "51a3c765-0fbe-472f-bf1d-a49f663bdeea"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Creating event network-changed:99ac8a24-e783-4834-a419-d58b3e288aa4 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] Creating event network-changed:51a3c765-0fbe-472f-bf1d-a49f663bdeea for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-70095099-6d09-4e24-a2e0-30548ab3e00f req-ea882ddb-75a4-4064-a910-4e106988916f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045872 Apr 11 17:04:22 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 41/122] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:22 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:23 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "tag": "50c39df9-0b72-4b14-96ca-356d0dc32f1c"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:23 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] Creating event network-changed:50c39df9-0b72-4b14-96ca-356d0dc32f1c for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:23 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-ecd57384-7b0c-42dd-a804-17e2fae5c66a req-45ab6ea4-6c2b-4f76-9748-5ade748582a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047945 Apr 11 17:04:23 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 43/123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:23 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:23 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=12 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:23 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "tag": "39c10a5f-6007-4268-a337-da0f1c17c553"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:24 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] Creating event network-changed:39c10a5f-6007-4268-a337-da0f1c17c553 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:24 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-67224627-4304-418c-89f4-097868bc7582 req-a0e2c3fd-4406-4531-af80-600468ee6bb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.415771 Apr 11 17:04:24 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 40/124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:25 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=14 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "tag": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] Creating event network-changed:9d81600b-d6e0-4715-9c00-f24f7a2d8fcb for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5f4a66c1-ec3a-440e-a29b-90516e944680 req-3d44c674-891c-434a-8709-c0cf72c609f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037131 Apr 11 17:04:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:30 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-7f200c36-36a3-4ae9-b4ad-a1e49a562ec0 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:30 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-7f200c36-36a3-4ae9-b4ad-a1e49a562ec0 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f200c36-36a3-4ae9-b4ad-a1e49a562ec0 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f200c36-36a3-4ae9-b4ad-a1e49a562ec0 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f200c36-36a3-4ae9-b4ad-a1e49a562ec0 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f200c36-36a3-4ae9-b4ad-a1e49a562ec0 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f200c36-36a3-4ae9-b4ad-a1e49a562ec0 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f200c36-36a3-4ae9-b4ad-a1e49a562ec0 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:30 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-7f200c36-36a3-4ae9-b4ad-a1e49a562ec0 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20dcfb0f94c419b9111571e89bc3aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9791f1371ba74005a40cd51a63d63c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:04:30 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-7f200c36-36a3-4ae9-b4ad-a1e49a562ec0 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404" status: 200 len: 1525 microversion: 2.1 time: 0.152266 Apr 11 17:04:30 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 44/126] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:04:30 2023] GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404 => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:04:38 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:38 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=17 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:38 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "7320c7cb-cd67-4b96-bcd0-865515f9b472"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:38 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] Creating event network-vif-plugged:7320c7cb-cd67-4b96-bcd0-865515f9b472 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:38 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-ce05b3cb-da7f-430b-8a7a-c748601c0870 req-9709cbc4-6caf-4b4d-b16f-e829c2d5ff12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038479 Apr 11 17:04:38 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 41/127] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:38 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:38 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=21 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:38 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "a4c6824f-e5f7-4f25-81eb-5cc534c99636"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] Creating event network-vif-plugged:a4c6824f-e5f7-4f25-81eb-5cc534c99636 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-bf27c9e5-01b2-422e-8b3e-eca5bae3fcff req-3743b078-8a9d-4e5f-9f46-2457496b084b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049748 Apr 11 17:04:38 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 43/128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:40 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "7320c7cb-cd67-4b96-bcd0-865515f9b472"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "8a27e645-0909-4786-a624-5d12630f2e1b"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "8a27e645-0909-4786-a624-5d12630f2e1b"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:40 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:40 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=15 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:40 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Creating event network-vif-plugged:7320c7cb-cd67-4b96-bcd0-865515f9b472 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:40 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Creating event network-vif-plugged:8a27e645-0909-4786-a624-5d12630f2e1b for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:40 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] Creating event network-vif-plugged:8a27e645-0909-4786-a624-5d12630f2e1b for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:40 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-541ad338-8119-4bd6-b23f-1fa4faafcc3a req-426e7185-bbdd-4dbd-a2de-0a483802136b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044909 Apr 11 17:04:40 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 45/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:40 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:40 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "a4c6824f-e5f7-4f25-81eb-5cc534c99636"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "818fbdc6-1f85-4f25-a9a8-99aec719102e"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "818fbdc6-1f85-4f25-a9a8-99aec719102e"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "c6dc07d2-c1e5-44f7-8683-0162519e8613"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "c6dc07d2-c1e5-44f7-8683-0162519e8613"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "99ac8a24-e783-4834-a419-d58b3e288aa4"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "99ac8a24-e783-4834-a419-d58b3e288aa4"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Creating event network-vif-plugged:a4c6824f-e5f7-4f25-81eb-5cc534c99636 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Creating event network-vif-plugged:818fbdc6-1f85-4f25-a9a8-99aec719102e for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Creating event network-vif-plugged:818fbdc6-1f85-4f25-a9a8-99aec719102e for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Creating event network-vif-plugged:c6dc07d2-c1e5-44f7-8683-0162519e8613 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Creating event network-vif-plugged:c6dc07d2-c1e5-44f7-8683-0162519e8613 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Creating event network-vif-plugged:99ac8a24-e783-4834-a419-d58b3e288aa4 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] Creating event network-vif-plugged:99ac8a24-e783-4834-a419-d58b3e288aa4 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-7925c955-3263-4b57-83a4-7788f9ba0bfa req-4e0cda07-ef65-4f90-99bc-7d49ec0e4020 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.053346 Apr 11 17:04:41 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 42/130] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 17:04:40 2023] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:04:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "51a3c765-0fbe-472f-bf1d-a49f663bdeea"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] Creating event network-vif-plugged:51a3c765-0fbe-472f-bf1d-a49f663bdeea for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-0d144203-693f-4e02-8f4d-d20d22530f03 req-7720d861-3827-404c-8643-1414b03214dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032682 Apr 11 17:04:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 44/131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:42 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "dfdf099d-908f-40d1-937c-cfa70a5b38b5"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "dfdf099d-908f-40d1-937c-cfa70a5b38b5"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Creating event network-vif-plugged:dfdf099d-908f-40d1-937c-cfa70a5b38b5 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] Creating event network-vif-plugged:dfdf099d-908f-40d1-937c-cfa70a5b38b5 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-8f1939b6-e4a6-485c-afa1-1ef6416275b3 req-842b587b-35d0-407e-b037-c1e13cfc7730 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036112 Apr 11 17:04:42 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 46/132] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:43 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "51a3c765-0fbe-472f-bf1d-a49f663bdeea"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "f73daf99-e281-41dc-87d9-f257045a8146"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "f73daf99-e281-41dc-87d9-f257045a8146"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "0affebd5-561c-497c-9491-338dce8905e9"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "0affebd5-561c-497c-9491-338dce8905e9"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "84d3c99c-9ae0-4d15-8338-ece1d9a04125"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Creating event network-vif-plugged:51a3c765-0fbe-472f-bf1d-a49f663bdeea for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:04:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Creating event network-vif-plugged:f73daf99-e281-41dc-87d9-f257045a8146 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Creating event network-vif-plugged:f73daf99-e281-41dc-87d9-f257045a8146 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Creating event network-vif-plugged:0affebd5-561c-497c-9491-338dce8905e9 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Creating event network-vif-plugged:0affebd5-561c-497c-9491-338dce8905e9 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] Creating event network-vif-plugged:84d3c99c-9ae0-4d15-8338-ece1d9a04125 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-2f3a8a8b-17ee-422b-8d46-7e294e2be38a req-d0305174-6c2c-42c7-bc90-f5affaf6da05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.048409 Apr 11 17:04:43 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 43/133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:43 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:04:44 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "39c10a5f-6007-4268-a337-da0f1c17c553"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "39c10a5f-6007-4268-a337-da0f1c17c553"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Creating event network-vif-plugged:39c10a5f-6007-4268-a337-da0f1c17c553 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Creating event network-vif-plugged:39c10a5f-6007-4268-a337-da0f1c17c553 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Creating event network-vif-plugged:9d81600b-d6e0-4715-9c00-f24f7a2d8fcb for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] Creating event network-vif-plugged:9d81600b-d6e0-4715-9c00-f24f7a2d8fcb for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-f1213e9f-1208-4ed4-9b97-0882ab01ab68 req-355cd64b-1559-4909-b88f-d813551cc8dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.032598 Apr 11 17:04:44 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 45/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:44 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:45 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "84d3c99c-9ae0-4d15-8338-ece1d9a04125"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "50c39df9-0b72-4b14-96ca-356d0dc32f1c"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "50c39df9-0b72-4b14-96ca-356d0dc32f1c"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:45 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:45 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:45 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:45 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Creating event network-vif-plugged:84d3c99c-9ae0-4d15-8338-ece1d9a04125 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:45 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Creating event network-vif-plugged:50c39df9-0b72-4b14-96ca-356d0dc32f1c for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:45 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] Creating event network-vif-plugged:50c39df9-0b72-4b14-96ca-356d0dc32f1c for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:04:45 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-e5e385d6-c390-4a99-8112-fceaa679aa63 req-618f3b23-388e-4760-830f-22906a95e030 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035442 Apr 11 17:04:45 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 47/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:04:45 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:58 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:58 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:58 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-9bab55c1-d92e-46c5-a730-088e31dbf9e7 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:58 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-9bab55c1-d92e-46c5-a730-088e31dbf9e7 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9bab55c1-d92e-46c5-a730-088e31dbf9e7 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9bab55c1-d92e-46c5-a730-088e31dbf9e7 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9bab55c1-d92e-46c5-a730-088e31dbf9e7 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9bab55c1-d92e-46c5-a730-088e31dbf9e7 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9bab55c1-d92e-46c5-a730-088e31dbf9e7 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9bab55c1-d92e-46c5-a730-088e31dbf9e7 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:58 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-9bab55c1-d92e-46c5-a730-088e31dbf9e7 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.214815 Apr 11 17:04:58 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 44/136] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:04:58 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-interface => generated 283 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:04:59 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:59 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:59 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:04:59 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:59 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'flavor' on Instance uuid 58e3bca8-f38a-45d1-98c2-06391f9f31fd {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:04:59 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-aaa38597-77ac-48c5-9c49-14ab216012c8 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd/action" status: 200 len: 32 microversion: 2.1 time: 0.619329 Apr 11 17:04:59 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 46/137] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:04:59 2023] POST /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd/action => generated 32 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:04:59 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:59 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:04:59 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-68d33884-97c3-40f4-8c5e-3dfbf51c1bc9 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:04:59 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-68d33884-97c3-40f4-8c5e-3dfbf51c1bc9 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:04:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-68d33884-97c3-40f4-8c5e-3dfbf51c1bc9 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-68d33884-97c3-40f4-8c5e-3dfbf51c1bc9 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-68d33884-97c3-40f4-8c5e-3dfbf51c1bc9 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:04:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-68d33884-97c3-40f4-8c5e-3dfbf51c1bc9 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:04:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-68d33884-97c3-40f4-8c5e-3dfbf51c1bc9 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:04:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-68d33884-97c3-40f4-8c5e-3dfbf51c1bc9 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:00 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-68d33884-97c3-40f4-8c5e-3dfbf51c1bc9 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:00 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-68d33884-97c3-40f4-8c5e-3dfbf51c1bc9 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd" status: 200 len: 1511 microversion: 2.1 time: 0.371133 Apr 11 17:05:00 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 48/138] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:04:59 2023] GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd => generated 1511 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-171ca149-15bc-4745-ad1c-b1acd8767a71 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee" status: 200 len: 2816 microversion: 2.32 time: 0.350405 Apr 11 17:05:00 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 45/139] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:05:00 2023] GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee => generated 2816 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 17:05:00 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:00 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] Creating event network-changed:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:05:00 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5b2f0792-13f8-4828-b09b-0da48f72a5cb req-36f51e62-0184-4904-b5e1-6eb012123087 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036599 Apr 11 17:05:00 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 47/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:00 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1547842173"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:00 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:01 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:01 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:01 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:01 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-dfc29048-4b70-43c7-9418-446f20f333e4 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" status: 200 len: 2829 microversion: 2.42 time: 0.264310 Apr 11 17:05:01 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 46/141] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:05:00 2023] GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 => generated 2829 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:05:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d094c81b-4af4-41ae-859d-c6fdf3b47617 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:01 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d094c81b-4af4-41ae-859d-c6fdf3b47617 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d094c81b-4af4-41ae-859d-c6fdf3b47617 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d094c81b-4af4-41ae-859d-c6fdf3b47617 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d094c81b-4af4-41ae-859d-c6fdf3b47617 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d094c81b-4af4-41ae-859d-c6fdf3b47617 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d094c81b-4af4-41ae-859d-c6fdf3b47617 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d094c81b-4af4-41ae-859d-c6fdf3b47617 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-aac217a5-5622-4b4d-9f8e-d3dbcde628cd tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "POST /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/action" status: 202 len: 0 microversion: 2.1 time: 1.203793 Apr 11 17:05:01 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 49/142] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:05:00 2023] POST /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/action => generated 0 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 17:05:01 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-97d53a7f-cccf-432e-a71d-1c59b9b9084f tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '.version_select at 0x7f5bdddca440>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:01 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-97d53a7f-cccf-432e-a71d-1c59b9b9084f tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/images/092f4818-05d2-4f43-becf-b000e59860ae" status: 200 len: 1611 microversion: 2.1 time: 0.057996 Apr 11 17:05:01 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 47/143] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 17:05:01 2023] GET /compute/v2.1/images/092f4818-05d2-4f43-becf-b000e59860ae => generated 1611 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d094c81b-4af4-41ae-859d-c6fdf3b47617 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.119995 Apr 11 17:05:01 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:05:01 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-interface => generated 282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:02 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e3bca8-f38a-45d1-98c2-06391f9f31fd", "name": "network-vif-unplugged", "status": "completed", "tag": "153bd902-5486-49d7-8f56-9ac648664124"}, {"server_uuid": "58e3bca8-f38a-45d1-98c2-06391f9f31fd", "name": "network-vif-plugged", "status": "completed", "tag": "153bd902-5486-49d7-8f56-9ac648664124"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:02 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Creating event network-vif-unplugged:153bd902-5486-49d7-8f56-9ac648664124 for instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd on user Apr 11 17:05:02 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] Creating event network-vif-plugged:153bd902-5486-49d7-8f56-9ac648664124 for instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd on user Apr 11 17:05:02 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-dd04327e-8df2-442a-b80b-a6b551195b01 req-f639b325-9d74-4040-b03a-1bcffe602a51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.049808 Apr 11 17:05:02 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 50/145] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:02 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:03 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] Creating event network-changed:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:05:03 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-a2adf8a0-cc3b-48d2-90e1-ca2f131defd7 req-c8c2bec1-1e24-42f0-bd8c-8894f9afbafc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040415 Apr 11 17:05:03 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 48/146] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:03 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6e86c78f-1c90-43d0-bdd4-c98bbcb13709 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:03 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-6e86c78f-1c90-43d0-bdd4-c98bbcb13709 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e86c78f-1c90-43d0-bdd4-c98bbcb13709 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e86c78f-1c90-43d0-bdd4-c98bbcb13709 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e86c78f-1c90-43d0-bdd4-c98bbcb13709 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e86c78f-1c90-43d0-bdd4-c98bbcb13709 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e86c78f-1c90-43d0-bdd4-c98bbcb13709 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e86c78f-1c90-43d0-bdd4-c98bbcb13709 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:03 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-6e86c78f-1c90-43d0-bdd4-c98bbcb13709 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:03 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-6e86c78f-1c90-43d0-bdd4-c98bbcb13709 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1540 microversion: 2.1 time: 0.240709 Apr 11 17:05:03 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 49/147] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:05:03 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1540 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:03 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-9691340c-8ef8-4e82-9a03-17529361f371 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:03 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-9691340c-8ef8-4e82-9a03-17529361f371 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9691340c-8ef8-4e82-9a03-17529361f371 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9691340c-8ef8-4e82-9a03-17529361f371 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9691340c-8ef8-4e82-9a03-17529361f371 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9691340c-8ef8-4e82-9a03-17529361f371 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9691340c-8ef8-4e82-9a03-17529361f371 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9691340c-8ef8-4e82-9a03-17529361f371 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:03 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-9691340c-8ef8-4e82-9a03-17529361f371 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:03 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-9691340c-8ef8-4e82-9a03-17529361f371 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1540 microversion: 2.1 time: 0.184727 Apr 11 17:05:03 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 51/148] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:05:03 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1540 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-7db88977-b91a-4394-8bf2-4cfd42661339 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-7db88977-b91a-4394-8bf2-4cfd42661339 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7db88977-b91a-4394-8bf2-4cfd42661339 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7db88977-b91a-4394-8bf2-4cfd42661339 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.053s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7db88977-b91a-4394-8bf2-4cfd42661339 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7db88977-b91a-4394-8bf2-4cfd42661339 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7db88977-b91a-4394-8bf2-4cfd42661339 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7db88977-b91a-4394-8bf2-4cfd42661339 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1473449920"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:04 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a328310-4c85-49de-a84c-330dab872557"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:04 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:04 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-7db88977-b91a-4394-8bf2-4cfd42661339 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f7d3b94cc6b4a7d95489d7d4cf6e297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4085a617084465ae810ff06498f992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-7db88977-b91a-4394-8bf2-4cfd42661339 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790" status: 200 len: 1540 microversion: 2.1 time: 0.244696 Apr 11 17:05:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 49/149] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:05:03 2023] GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790 => generated 1540 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:04 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e3bca8-f38a-45d1-98c2-06391f9f31fd", "name": "network-vif-plugged", "status": "completed", "tag": "153bd902-5486-49d7-8f56-9ac648664124"}, {"server_uuid": "58e3bca8-f38a-45d1-98c2-06391f9f31fd", "name": "network-vif-plugged", "status": "completed", "tag": "153bd902-5486-49d7-8f56-9ac648664124"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Creating event network-vif-plugged:153bd902-5486-49d7-8f56-9ac648664124 for instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd on user Apr 11 17:05:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] Creating event network-vif-plugged:153bd902-5486-49d7-8f56-9ac648664124 for instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd on user Apr 11 17:05:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-40ed4d4a-ee9a-470a-a422-2cdcc4c4d2de tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.795928 Apr 11 17:05:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 52/150] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:05:04 2023] POST /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-ec4178f6-2510-443a-8e94-3d713e793537 req-5498c17c-0587-4801-b905-ca2ad60abf4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035724 Apr 11 17:05:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 50/151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9d039fad-5fb1-4cb5-83f2-7f24b71e860d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b/action" status: 202 len: 52 microversion: 2.87 time: 1.034764 Apr 11 17:05:05 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 50/152] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 17:05:04 2023] POST /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b/action => generated 52 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 17:05:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:10 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:10 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:10 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:10 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-331eeddd-7416-4f69-9f8d-4f1c14a4c1ae tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b" status: 200 len: 1691 microversion: 2.87 time: 0.229125 Apr 11 17:05:10 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 53/153] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:05:10 2023] GET /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b => generated 1691 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:05:11 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2e02b442-83fb-4329-b74a-4e569a2538ea tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:11 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2e02b442-83fb-4329-b74a-4e569a2538ea tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e02b442-83fb-4329-b74a-4e569a2538ea tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e02b442-83fb-4329-b74a-4e569a2538ea tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e02b442-83fb-4329-b74a-4e569a2538ea tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e02b442-83fb-4329-b74a-4e569a2538ea tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e02b442-83fb-4329-b74a-4e569a2538ea tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e02b442-83fb-4329-b74a-4e569a2538ea tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2e02b442-83fb-4329-b74a-4e569a2538ea tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.094666 Apr 11 17:05:11 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 51/154] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:05:11 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/os-interface => generated 283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] Creating event network-changed:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:05:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-b0fa5f38-39eb-40ee-be0a-be6a8a78edf9 req-9fba7472-2a74-4988-9d24-0be40aa6af5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033352 Apr 11 17:05:12 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 51/155] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-5540b6f7-72e4-40b4-b10a-00b488760a98 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-5540b6f7-72e4-40b4-b10a-00b488760a98 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5540b6f7-72e4-40b4-b10a-00b488760a98 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5540b6f7-72e4-40b4-b10a-00b488760a98 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5540b6f7-72e4-40b4-b10a-00b488760a98 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5540b6f7-72e4-40b4-b10a-00b488760a98 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5540b6f7-72e4-40b4-b10a-00b488760a98 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5540b6f7-72e4-40b4-b10a-00b488760a98 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-5540b6f7-72e4-40b4-b10a-00b488760a98 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/ips" status: 200 len: 105 microversion: 2.1 time: 0.038767 Apr 11 17:05:12 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 54/156] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 17:05:12 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/ips => generated 105 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:12 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:12 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:12 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:05:12 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2cccaea7-e8c3-43db-9fae-702279ceddbb tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41" status: 204 len: 0 microversion: 2.1 time: 0.148574 Apr 11 17:05:12 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:05:12 2023] DELETE /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-35b005fe-d598-44b4-823a-e7807952b039 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-35b005fe-d598-44b4-823a-e7807952b039 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-35b005fe-d598-44b4-823a-e7807952b039 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-35b005fe-d598-44b4-823a-e7807952b039 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-35b005fe-d598-44b4-823a-e7807952b039 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-35b005fe-d598-44b4-823a-e7807952b039 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-35b005fe-d598-44b4-823a-e7807952b039 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-35b005fe-d598-44b4-823a-e7807952b039 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:12 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-35b005fe-d598-44b4-823a-e7807952b039 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c74611f9b01a45ef8cfbb50fa9b06cc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e0fe3df39a64a39934d199c01985777', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-35b005fe-d598-44b4-823a-e7807952b039 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41" status: 200 len: 1543 microversion: 2.1 time: 0.252681 Apr 11 17:05:12 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 52/158] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:05:12 2023] GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41 => generated 1543 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6687cdc1-6ab3-4e6d-b4a4-e03772606c41", "name": "network-vif-unplugged", "status": "completed", "tag": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] Creating event network-vif-unplugged:5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 for instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 on user Apr 11 17:05:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-75060d8b-35a0-47c6-8890-23e5d0d7f4a3 req-4564a051-654e-4927-9778-5e0478840d3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030817 Apr 11 17:05:12 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 55/159] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:13 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9628077-d981-481d-a434-92ba15259efd"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:13 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:13 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-807da6df-30f0-4c23-8014-974a12ad5406 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315894 Apr 11 17:05:13 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 53/160] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:05:13 2023] POST /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:15 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6687cdc1-6ab3-4e6d-b4a4-e03772606c41", "name": "network-vif-plugged", "status": "completed", "tag": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20"}, {"server_uuid": "6687cdc1-6ab3-4e6d-b4a4-e03772606c41", "name": "network-vif-deleted", "tag": "5b56bc1c-c00c-4398-ad90-9dc3b8c71f20"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] Creating event network-vif-plugged:5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 for instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 on user Apr 11 17:05:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] Creating event network-vif-deleted:5b56bc1c-c00c-4398-ad90-9dc3b8c71f20 for instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 on user Apr 11 17:05:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-11c71bed-2238-4146-b559-ff3abbe0d7c3 req-293d529e-e483-41a1-bdbf-85d08c649e65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031518 Apr 11 17:05:15 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 53/161] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-515c7426-08c0-400d-9dbe-2846946a131a tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:18 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-515c7426-08c0-400d-9dbe-2846946a131a tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-515c7426-08c0-400d-9dbe-2846946a131a tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-515c7426-08c0-400d-9dbe-2846946a131a tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-515c7426-08c0-400d-9dbe-2846946a131a tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-515c7426-08c0-400d-9dbe-2846946a131a tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-515c7426-08c0-400d-9dbe-2846946a131a tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-515c7426-08c0-400d-9dbe-2846946a131a tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-515c7426-08c0-400d-9dbe-2846946a131a tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.098525 Apr 11 17:05:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 56/162] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:05:18 2023] GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-interface => generated 282 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd4a3a0-35a6-4f62-abc1-6a806ab62783", "tag": "c93de33f-8a35-40fb-bb48-f717e6fb90f6"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] Creating event network-changed:c93de33f-8a35-40fb-bb48-f717e6fb90f6 for instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 on user Apr 11 17:05:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-48065ec1-a435-4bea-be6c-4f5996c53113 req-2fafc647-9761-4368-9696-567b9cbf5f45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037942 Apr 11 17:05:20 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 54/163] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:20 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:20 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Going to try to stop instance {{(pid=61422) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 17:05:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-6a0557d0-e3dd-463a-9323-98eaa1e45cfc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/action" status: 202 len: 0 microversion: 2.1 time: 0.110604 Apr 11 17:05:20 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 54/164] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:05:20 2023] POST /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:05:20 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-53251d1e-0abc-4ae7-a593-ff219641836e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:20 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-53251d1e-0abc-4ae7-a593-ff219641836e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-53251d1e-0abc-4ae7-a593-ff219641836e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-53251d1e-0abc-4ae7-a593-ff219641836e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-53251d1e-0abc-4ae7-a593-ff219641836e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-53251d1e-0abc-4ae7-a593-ff219641836e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-53251d1e-0abc-4ae7-a593-ff219641836e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-53251d1e-0abc-4ae7-a593-ff219641836e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:20 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-53251d1e-0abc-4ae7-a593-ff219641836e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:20 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-53251d1e-0abc-4ae7-a593-ff219641836e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 200 len: 1713 microversion: 2.1 time: 0.179292 Apr 11 17:05:20 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 57/165] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:05:20 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 1713 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-87ba3a56-3bbd-4439-abb6-bfc0e35c9592 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-87ba3a56-3bbd-4439-abb6-bfc0e35c9592 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-87ba3a56-3bbd-4439-abb6-bfc0e35c9592 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-87ba3a56-3bbd-4439-abb6-bfc0e35c9592 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-87ba3a56-3bbd-4439-abb6-bfc0e35c9592 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-87ba3a56-3bbd-4439-abb6-bfc0e35c9592 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-87ba3a56-3bbd-4439-abb6-bfc0e35c9592 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-87ba3a56-3bbd-4439-abb6-bfc0e35c9592 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-87ba3a56-3bbd-4439-abb6-bfc0e35c9592 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.108569 Apr 11 17:05:20 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 55/166] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:05:20 2023] GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-interface => generated 283 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:20 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-unplugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] Creating event network-vif-unplugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:05:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-ffa030d5-904c-45c0-8e10-96a455892d68 req-0c24ac3f-0330-4ff2-94fe-32a6dc384958 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033313 Apr 11 17:05:21 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 55/167] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:21 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0f3da1e-ec0b-4443-8e26-d9db454344ab"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:21 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c3ba093b-7d03-41b9-a602-bbad69269707 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.431297 Apr 11 17:05:22 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 58/168] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:05:21 2023] POST /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:22 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e", "tag": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:22 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] Creating event network-changed:68bea989-7c25-4d4d-aa6d-e4fe977ebb93 for instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e on user Apr 11 17:05:22 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-f213bddd-f79c-441e-bfc3-dc49db55c2a3 req-06819bde-d44d-443c-addc-3ff4d85a076d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035591 Apr 11 17:05:22 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 56/169] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:23 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:23 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:05:23 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-57a1f27b-aa4a-4b72-aec9-9ff5d5c26f24 req-160ba49d-218a-4ed1-a3bd-b7c89737db85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059228 Apr 11 17:05:23 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 56/170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:23 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "479230cb-0e0b-47ce-b9f6-cff7797f61d7"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:23 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:23 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-74999d71-e89c-4712-92f8-dc6857dab1d1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346556 Apr 11 17:05:23 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 59/171] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:05:23 2023] POST /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-1ac34649-1716-44ca-ae19-b52cf14e5716 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:28 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-1ac34649-1716-44ca-ae19-b52cf14e5716 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:28 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1ac34649-1716-44ca-ae19-b52cf14e5716 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1ac34649-1716-44ca-ae19-b52cf14e5716 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1ac34649-1716-44ca-ae19-b52cf14e5716 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1ac34649-1716-44ca-ae19-b52cf14e5716 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1ac34649-1716-44ca-ae19-b52cf14e5716 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1ac34649-1716-44ca-ae19-b52cf14e5716 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:28 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-1ac34649-1716-44ca-ae19-b52cf14e5716 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047744 Apr 11 17:05:28 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 57/172] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:05:28 2023] GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:28 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:29 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lazy-loading 'services' on Instance uuid cdd4a3a0-35a6-4f62-abc1-6a806ab62783 {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:05:29 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-59de476c-7647-48c9-b61a-ffda2bcf2c26 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-volume_attachments/c0f3da1e-ec0b-4443-8e26-d9db454344ab" status: 202 len: 0 microversion: 2.1 time: 0.276511 Apr 11 17:05:29 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 57/173] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:05:28 2023] DELETE /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-volume_attachments/c0f3da1e-ec0b-4443-8e26-d9db454344ab => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:05:30 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-75f61596-eec4-400b-ac5f-c0fba09ca56a tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:30 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-75f61596-eec4-400b-ac5f-c0fba09ca56a tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:30 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=27 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75f61596-eec4-400b-ac5f-c0fba09ca56a tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75f61596-eec4-400b-ac5f-c0fba09ca56a tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75f61596-eec4-400b-ac5f-c0fba09ca56a tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75f61596-eec4-400b-ac5f-c0fba09ca56a tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75f61596-eec4-400b-ac5f-c0fba09ca56a tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75f61596-eec4-400b-ac5f-c0fba09ca56a tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:30 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:30 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-75f61596-eec4-400b-ac5f-c0fba09ca56a tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.108305 Apr 11 17:05:30 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 60/174] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:05:30 2023] GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-interface => generated 282 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7088eecb-6600-4cb7-8ce5-85fc7e5db1f2 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-7088eecb-6600-4cb7-8ce5-85fc7e5db1f2 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=25 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7088eecb-6600-4cb7-8ce5-85fc7e5db1f2 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7088eecb-6600-4cb7-8ce5-85fc7e5db1f2 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7088eecb-6600-4cb7-8ce5-85fc7e5db1f2 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7088eecb-6600-4cb7-8ce5-85fc7e5db1f2 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7088eecb-6600-4cb7-8ce5-85fc7e5db1f2 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7088eecb-6600-4cb7-8ce5-85fc7e5db1f2 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7088eecb-6600-4cb7-8ce5-85fc7e5db1f2 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050358 Apr 11 17:05:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 58/175] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:05:31 2023] GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7b5a3714-d9c3-46da-aa49-b1e9d1db73e7"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c702e02f-b7f9-4c23-b719-94b5e110cf56 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c702e02f-b7f9-4c23-b719-94b5e110cf56 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c702e02f-b7f9-4c23-b719-94b5e110cf56 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c702e02f-b7f9-4c23-b719-94b5e110cf56 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c702e02f-b7f9-4c23-b719-94b5e110cf56 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180c44cc-172d-4e8c-b4ec-6259e775c404", "tag": "3bc601e8-552e-473e-abe3-24e32a78188f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c702e02f-b7f9-4c23-b719-94b5e110cf56 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c702e02f-b7f9-4c23-b719-94b5e110cf56 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c702e02f-b7f9-4c23-b719-94b5e110cf56 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] Creating event network-changed:3bc601e8-552e-473e-abe3-24e32a78188f for instance 180c44cc-172d-4e8c-b4ec-6259e775c404 on user Apr 11 17:05:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-ebf3b190-4a3a-4c2a-8048-502c3a432640 req-80bf89a0-2ed9-4e1c-979c-0f0b32b2c853 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029305 Apr 11 17:05:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 59/176] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1db9739e-54c3-4cb3-b225-7fb33f46160d"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c702e02f-b7f9-4c23-b719-94b5e110cf56 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073543 Apr 11 17:05:31 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 61/177] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:05:31 2023] GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:05:31 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] HTTP exception thrown: Volume 7b5a3714-d9c3-46da-aa49-b1e9d1db73e7 could not be found. Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Request method failure captured: Apr 11 17:05:31 user devstack@n-api.service[61423]: request: PUT /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-volume_attachments/479230cb-0e0b-47ce-b9f6-cff7797f61d7 HTTP/1.1 Apr 11 17:05:31 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:05:31 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:05:31 user devstack@n-api.service[61423]: Connection: close Apr 11 17:05:31 user devstack@n-api.service[61423]: Content-Length: 74 Apr 11 17:05:31 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:05:31 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:05:31 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:05:31 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLdwVZe9xTn2EV8sAlQD8SlVh3GAjAfzXX7p9YI7_uI44A9oJYblprubM2m-zUr0qMROxXlbD42HMLca0re8Kh-FI_9wQblqpzTjnNl08s_hlpViGoQYlVkd7Mr2RBBWHXxS64eDCeBMvfYZmAwoVkq68SKp5OcN-UYdlrCVtdjQjk Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Project-Id: 0c87979fc29a4e71a854987def1a84fb Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Project-Name: tempest-VolumesAdminNegativeTest-966721324 Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Role: reader,member,admin Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Roles: reader,member,admin Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c87979fc29a4e71a854987def1a84fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c87979fc29a4e71a854987def1a84fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c87979fc29a4e71a854987def1a84fb"}]}] Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Tenant: tempest-VolumesAdminNegativeTest-966721324 Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Tenant-Id: 0c87979fc29a4e71a854987def1a84fb Apr 11 17:05:31 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-966721324 Apr 11 17:05:31 user devstack@n-api.service[61423]: X-User: tempest-VolumesAdminNegativeTest-966721324-project-admin Apr 11 17:05:31 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:05:31 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:05:31 user devstack@n-api.service[61423]: X-User-Id: c3d4d79b57e74885bc3b9a05a5f4b5a5 Apr 11 17:05:31 user devstack@n-api.service[61423]: X-User-Name: tempest-VolumesAdminNegativeTest-966721324-project-admin Apr 11 17:05:31 user devstack@n-api.service[61423]: Apr 11 17:05:31 user devstack@n-api.service[61423]: {"volumeAttachment": {"volumeId": "7b5a3714-d9c3-46da-aa49-b1e9d1db73e7"}} Apr 11 17:05:31 user devstack@n-api.service[61423]: method: > Apr 11 17:05:31 user devstack@n-api.service[61423]: exception: Volume 7b5a3714-d9c3-46da-aa49-b1e9d1db73e7 could not be found. Apr 11 17:05:31 user devstack@n-api.service[61423]: action_args: {'server_id': '2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e', 'id': '479230cb-0e0b-47ce-b9f6-cff7797f61d7', 'body': {'volumeAttachment': {'volumeId': '7b5a3714-d9c3-46da-aa49-b1e9d1db73e7'}}} Apr 11 17:05:31 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b5a3714-d9c3-46da-aa49-b1e9d1db73e7 could not be found. (HTTP 404) (Request-ID: req-a6bf7ffc-a41e-4e47-980d-95dc303890bf) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b5a3714-d9c3-46da-aa49-b1e9d1db73e7 could not be found. Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 7b5a3714-d9c3-46da-aa49-b1e9d1db73e7 could not be found. Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b5a3714-d9c3-46da-aa49-b1e9d1db73e7 could not be found. Apr 11 17:05:31 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Returning 400 to user: Volume 7b5a3714-d9c3-46da-aa49-b1e9d1db73e7 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:05:31 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-8751b236-e7c1-40c0-8313-fd8ecf6057f5 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-volume_attachments/479230cb-0e0b-47ce-b9f6-cff7797f61d7" status: 400 len: 107 microversion: 2.1 time: 0.325388 Apr 11 17:05:31 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 58/178] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 17:05:31 2023] PUT /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-volume_attachments/479230cb-0e0b-47ce-b9f6-cff7797f61d7 => generated 107 bytes in 327 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-810807ff-4e8c-446a-a942-c28ecff36b68 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783" status: 204 len: 0 microversion: 2.1 time: 0.155298 Apr 11 17:05:31 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 62/179] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:05:31 2023] DELETE /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-bdeb5197-a764-4cc8-90fa-81c0265aac5c tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-bdeb5197-a764-4cc8-90fa-81c0265aac5c tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bdeb5197-a764-4cc8-90fa-81c0265aac5c tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bdeb5197-a764-4cc8-90fa-81c0265aac5c tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bdeb5197-a764-4cc8-90fa-81c0265aac5c tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bdeb5197-a764-4cc8-90fa-81c0265aac5c tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bdeb5197-a764-4cc8-90fa-81c0265aac5c tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bdeb5197-a764-4cc8-90fa-81c0265aac5c tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lazy-loading 'services' on Instance uuid 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:05:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-bc3b701f-9d57-4954-bd61-e2fb57cc319e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "POST /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313123 Apr 11 17:05:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 60/180] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:05:31 2023] POST /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:31 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-787b052c-a3a9-4e5e-ba1d-3d0f341e2aea tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-volume_attachments/479230cb-0e0b-47ce-b9f6-cff7797f61d7" status: 202 len: 0 microversion: 2.1 time: 0.302611 Apr 11 17:05:31 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 59/181] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:05:31 2023] DELETE /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-volume_attachments/479230cb-0e0b-47ce-b9f6-cff7797f61d7 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3c582d33-b0a4-4d39-8888-50579449c4dc tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-3c582d33-b0a4-4d39-8888-50579449c4dc tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c582d33-b0a4-4d39-8888-50579449c4dc tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c582d33-b0a4-4d39-8888-50579449c4dc tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c582d33-b0a4-4d39-8888-50579449c4dc tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c582d33-b0a4-4d39-8888-50579449c4dc tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c582d33-b0a4-4d39-8888-50579449c4dc tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c582d33-b0a4-4d39-8888-50579449c4dc tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:32 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3c582d33-b0a4-4d39-8888-50579449c4dc tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060291 Apr 11 17:05:32 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:05:31 2023] GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:32 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-bdeb5197-a764-4cc8-90fa-81c0265aac5c tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4b1a17c7804cd4ba2ad825e0cc2dd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7d76a8d4544e2b84d52eebb6d4b5b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:32 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-bdeb5197-a764-4cc8-90fa-81c0265aac5c tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783" status: 200 len: 1672 microversion: 2.1 time: 0.298921 Apr 11 17:05:32 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 63/183] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:05:31 2023] GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783 => generated 1672 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:32 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd4a3a0-35a6-4f62-abc1-6a806ab62783", "name": "network-vif-unplugged", "status": "completed", "tag": "c93de33f-8a35-40fb-bb48-f717e6fb90f6"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:32 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] Creating event network-vif-unplugged:c93de33f-8a35-40fb-bb48-f717e6fb90f6 for instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 on user Apr 11 17:05:32 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-f349a0c6-4dad-437f-8712-f01152854fb6 req-e7854908-0f23-4af6-b306-7e0a827a1c42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029295 Apr 11 17:05:32 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 60/184] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-c48c95c7-1f91-4b39-a29f-89fd9135b489 req-fb4c8179-2310-4df1-af7b-9e0c2ca2cd99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd4a3a0-35a6-4f62-abc1-6a806ab62783", "name": "network-vif-deleted", "tag": "c93de33f-8a35-40fb-bb48-f717e6fb90f6"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c48c95c7-1f91-4b39-a29f-89fd9135b489 req-fb4c8179-2310-4df1-af7b-9e0c2ca2cd99 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c48c95c7-1f91-4b39-a29f-89fd9135b489 req-fb4c8179-2310-4df1-af7b-9e0c2ca2cd99 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c48c95c7-1f91-4b39-a29f-89fd9135b489 req-fb4c8179-2310-4df1-af7b-9e0c2ca2cd99 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-c48c95c7-1f91-4b39-a29f-89fd9135b489 req-fb4c8179-2310-4df1-af7b-9e0c2ca2cd99 service nova] Creating event network-vif-deleted:c93de33f-8a35-40fb-bb48-f717e6fb90f6 for instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 on user Apr 11 17:05:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-c48c95c7-1f91-4b39-a29f-89fd9135b489 req-fb4c8179-2310-4df1-af7b-9e0c2ca2cd99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044492 Apr 11 17:05:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 62/185] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:34 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd4a3a0-35a6-4f62-abc1-6a806ab62783", "name": "network-vif-plugged", "status": "completed", "tag": "c93de33f-8a35-40fb-bb48-f717e6fb90f6"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:34 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] Creating event network-vif-plugged:c93de33f-8a35-40fb-bb48-f717e6fb90f6 for instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 on user Apr 11 17:05:34 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-1797869f-2c08-4642-829e-86ebc4547929 req-cdf238b6-dfe0-4389-84c5-fbb0455207d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040320 Apr 11 17:05:34 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 64/186] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:05:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:39 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "c040dff2-7d01-47a8-b5e8-a7c3d5e7414f"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:39 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:39 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-12156659-b0b6-4a87-a172-095758cb788f tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments/1db9739e-54c3-4cb3-b225-7fb33f46160d" status: 202 len: 0 microversion: 2.1 time: 0.387498 Apr 11 17:05:39 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 61/187] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 17:05:39 2023] PUT /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments/1db9739e-54c3-4cb3-b225-7fb33f46160d => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:05:50 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=9 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:50 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=27,nova_cell1:UPDATE=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:50 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-653f3b00-dbf6-4393-a0a8-7a55dc815307 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:50 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-653f3b00-dbf6-4393-a0a8-7a55dc815307 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-653f3b00-dbf6-4393-a0a8-7a55dc815307 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-653f3b00-dbf6-4393-a0a8-7a55dc815307 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-653f3b00-dbf6-4393-a0a8-7a55dc815307 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-653f3b00-dbf6-4393-a0a8-7a55dc815307 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-653f3b00-dbf6-4393-a0a8-7a55dc815307 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-653f3b00-dbf6-4393-a0a8-7a55dc815307 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:50 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-653f3b00-dbf6-4393-a0a8-7a55dc815307 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:50 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-653f3b00-dbf6-4393-a0a8-7a55dc815307 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd" status: 200 len: 1491 microversion: 2.1 time: 0.167342 Apr 11 17:05:50 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 63/188] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:05:50 2023] GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd => generated 1491 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:51 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:51 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:51 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-b1463cec-7b7c-47f3-9bb0-4010c9842292 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:51 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-b1463cec-7b7c-47f3-9bb0-4010c9842292 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1463cec-7b7c-47f3-9bb0-4010c9842292 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1463cec-7b7c-47f3-9bb0-4010c9842292 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1463cec-7b7c-47f3-9bb0-4010c9842292 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1463cec-7b7c-47f3-9bb0-4010c9842292 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1463cec-7b7c-47f3-9bb0-4010c9842292 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1463cec-7b7c-47f3-9bb0-4010c9842292 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:51 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-b1463cec-7b7c-47f3-9bb0-4010c9842292 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055887 Apr 11 17:05:51 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 65/189] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:05:51 2023] GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:51 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=9 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:51 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:05:51 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2ca46002-180e-45b0-b5cc-00b366d26b7c tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:51 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2ca46002-180e-45b0-b5cc-00b366d26b7c tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2ca46002-180e-45b0-b5cc-00b366d26b7c tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2ca46002-180e-45b0-b5cc-00b366d26b7c tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2ca46002-180e-45b0-b5cc-00b366d26b7c tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2ca46002-180e-45b0-b5cc-00b366d26b7c tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2ca46002-180e-45b0-b5cc-00b366d26b7c tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2ca46002-180e-45b0-b5cc-00b366d26b7c tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:51 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2ca46002-180e-45b0-b5cc-00b366d26b7c tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048218 Apr 11 17:05:51 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 62/190] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:05:51 2023] GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:05:51 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1db9739e-54c3-4cb3-b225-7fb33f46160d"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:05:51 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:51 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c2976121-c3df-4098-a294-e23530476ea2 tempest-TestVolumeSwap-1836305624 tempest-TestVolumeSwap-1836305624-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments/c040dff2-7d01-47a8-b5e8-a7c3d5e7414f" status: 202 len: 0 microversion: 2.1 time: 0.301197 Apr 11 17:05:52 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 64/191] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 17:05:51 2023] PUT /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments/c040dff2-7d01-47a8-b5e8-a7c3d5e7414f => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:05:52 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3d6af132-0eda-4df6-98bb-31eb9abd1342 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '.version_select at 0x7f5bdddf1ea0>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:52 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-3d6af132-0eda-4df6-98bb-31eb9abd1342 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/images/092f4818-05d2-4f43-becf-b000e59860ae" status: 200 len: 1725 microversion: 2.1 time: 0.057407 Apr 11 17:05:52 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 66/192] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 17:05:52 2023] GET /compute/v2.1/images/092f4818-05d2-4f43-becf-b000e59860ae => generated 1725 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:52 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ce621687-7922-4e77-b239-207a129a5de7 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '.version_select at 0x7f5bddb240d0>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:52 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ce621687-7922-4e77-b239-207a129a5de7 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/images/092f4818-05d2-4f43-becf-b000e59860ae" status: 200 len: 1725 microversion: 2.1 time: 0.052196 Apr 11 17:05:52 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 63/193] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 17:05:52 2023] GET /compute/v2.1/images/092f4818-05d2-4f43-becf-b000e59860ae => generated 1725 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:52 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f90a4c62-eedc-47be-9fa3-0678f5d9a296 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:52 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-f90a4c62-eedc-47be-9fa3-0678f5d9a296 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f90a4c62-eedc-47be-9fa3-0678f5d9a296 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f90a4c62-eedc-47be-9fa3-0678f5d9a296 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f90a4c62-eedc-47be-9fa3-0678f5d9a296 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f90a4c62-eedc-47be-9fa3-0678f5d9a296 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f90a4c62-eedc-47be-9fa3-0678f5d9a296 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f90a4c62-eedc-47be-9fa3-0678f5d9a296 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:52 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-f90a4c62-eedc-47be-9fa3-0678f5d9a296 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6126b468bd2414d831b105a3429ddd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b803e7cf929440298b14cd3177c96e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-f90a4c62-eedc-47be-9fa3-0678f5d9a296 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" status: 200 len: 1671 microversion: 2.1 time: 0.148106 Apr 11 17:05:52 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:05:52 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:05:53 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-655a0797-4da8-4000-a112-aff4d2cf4837 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:53 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-655a0797-4da8-4000-a112-aff4d2cf4837 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-655a0797-4da8-4000-a112-aff4d2cf4837 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-655a0797-4da8-4000-a112-aff4d2cf4837 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-655a0797-4da8-4000-a112-aff4d2cf4837 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-655a0797-4da8-4000-a112-aff4d2cf4837 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-655a0797-4da8-4000-a112-aff4d2cf4837 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-655a0797-4da8-4000-a112-aff4d2cf4837 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:53 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-655a0797-4da8-4000-a112-aff4d2cf4837 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:53 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-655a0797-4da8-4000-a112-aff4d2cf4837 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1658 microversion: 2.1 time: 0.162523 Apr 11 17:05:53 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 67/195] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:05:53 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1658 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 17:05:53 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-9f8a8839-2466-4a5e-b213-35046b9c3685 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:05:53 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-9f8a8839-2466-4a5e-b213-35046b9c3685 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:05:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f8a8839-2466-4a5e-b213-35046b9c3685 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f8a8839-2466-4a5e-b213-35046b9c3685 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f8a8839-2466-4a5e-b213-35046b9c3685 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f8a8839-2466-4a5e-b213-35046b9c3685 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:05:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f8a8839-2466-4a5e-b213-35046b9c3685 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:05:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f8a8839-2466-4a5e-b213-35046b9c3685 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:05:54 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-9f8a8839-2466-4a5e-b213-35046b9c3685 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:05:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-9f8a8839-2466-4a5e-b213-35046b9c3685 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1658 microversion: 2.1 time: 0.258241 Apr 11 17:05:54 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 64/196] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:05:53 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1658 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:06:00 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-efa6cd3b-3ed4-4281-96ac-8559577b5784 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:00 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-efa6cd3b-3ed4-4281-96ac-8559577b5784 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-efa6cd3b-3ed4-4281-96ac-8559577b5784 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-efa6cd3b-3ed4-4281-96ac-8559577b5784 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-efa6cd3b-3ed4-4281-96ac-8559577b5784 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-efa6cd3b-3ed4-4281-96ac-8559577b5784 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-efa6cd3b-3ed4-4281-96ac-8559577b5784 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-efa6cd3b-3ed4-4281-96ac-8559577b5784 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:00 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-efa6cd3b-3ed4-4281-96ac-8559577b5784 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.194876 Apr 11 17:06:00 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 66/197] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 17:06:00 2023] GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee/os-interface => generated 1828 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:06:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-8222c124-0277-4c51-809b-f15f255005cc tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:01 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-8222c124-0277-4c51-809b-f15f255005cc tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8222c124-0277-4c51-809b-f15f255005cc tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8222c124-0277-4c51-809b-f15f255005cc tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8222c124-0277-4c51-809b-f15f255005cc tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8222c124-0277-4c51-809b-f15f255005cc tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8222c124-0277-4c51-809b-f15f255005cc tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8222c124-0277-4c51-809b-f15f255005cc tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-8222c124-0277-4c51-809b-f15f255005cc tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.230278 Apr 11 17:06:01 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 68/198] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 17:06:01 2023] GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1/os-interface => generated 1829 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:06:01 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "tag": "7320c7cb-cd67-4b96-bcd0-865515f9b472"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:01 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] Creating event network-changed:7320c7cb-cd67-4b96-bcd0-865515f9b472 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:01 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-297adb78-3501-46eb-9ac4-31f171c629b8 req-413e3e8b-ce44-409e-957a-f983e51a04c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038874 Apr 11 17:06:01 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 65/199] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-6e2a5bac-015f-4859-8e1d-01b50a5327ec tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee" status: 200 len: 2816 microversion: 2.32 time: 0.445408 Apr 11 17:06:02 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 67/200] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:06:02 2023] GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee => generated 2816 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:06:02 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-787b9d61-220f-4f5b-be6d-3673ac23e84d tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:02 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-787b9d61-220f-4f5b-be6d-3673ac23e84d tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-787b9d61-220f-4f5b-be6d-3673ac23e84d tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-787b9d61-220f-4f5b-be6d-3673ac23e84d tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-787b9d61-220f-4f5b-be6d-3673ac23e84d tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-787b9d61-220f-4f5b-be6d-3673ac23e84d tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-787b9d61-220f-4f5b-be6d-3673ac23e84d tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-787b9d61-220f-4f5b-be6d-3673ac23e84d tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:02 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-787b9d61-220f-4f5b-be6d-3673ac23e84d tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.164856 Apr 11 17:06:02 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 69/201] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 17:06:02 2023] GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee/os-interface => generated 1828 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:06:02 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:02 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:02 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] HTTP exception thrown: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:02 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Request method failure captured: Apr 11 17:06:02 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41 HTTP/1.1 Apr 11 17:06:02 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:06:02 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:06:02 user devstack@n-api.service[61423]: Connection: close Apr 11 17:06:02 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:06:02 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:06:02 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:06:02 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:06:02 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLN5C3r7qxHCYsfNsZJQUAdRY5wI8VCDofVAqimoo4XNG7V9_HMkLefvPzrjpPnDVVcMX1ffLypXjoPCcogWkdMxBYDu4w2r1J4V8-Va5LRz4eXdBm_TfzpJ8wJDFQ4wJw4-nSjhZxqNdQ3diuVBNO7Wjt7zdjdGzE8TAF83jnimso Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Project-Id: 9e0fe3df39a64a39934d199c01985777 Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Project-Name: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e0fe3df39a64a39934d199c01985777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e0fe3df39a64a39934d199c01985777"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e0fe3df39a64a39934d199c01985777"}]}] Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Tenant: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Tenant-Id: 9e0fe3df39a64a39934d199c01985777 Apr 11 17:06:02 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:02 user devstack@n-api.service[61423]: X-User: tempest-DeleteServersTestJSON-1700911607-project-member Apr 11 17:06:02 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:06:02 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:06:02 user devstack@n-api.service[61423]: X-User-Id: c74611f9b01a45ef8cfbb50fa9b06cc8 Apr 11 17:06:02 user devstack@n-api.service[61423]: X-User-Name: tempest-DeleteServersTestJSON-1700911607-project-member Apr 11 17:06:02 user devstack@n-api.service[61423]: method: > Apr 11 17:06:02 user devstack@n-api.service[61423]: exception: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:02 user devstack@n-api.service[61423]: action_args: {'id': '6687cdc1-6ab3-4e6d-b4a4-e03772606c41'} Apr 11 17:06:02 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:02 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:02 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Returning 404 to user: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:02 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-b75440d9-8b51-4e5b-809e-6e43f5833e3f tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41" status: 404 len: 111 microversion: 2.1 time: 0.039204 Apr 11 17:06:02 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 66/202] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:06:02 2023] GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:02 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:03 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] HTTP exception thrown: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Request method failure captured: Apr 11 17:06:03 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/os-volume_attachments HTTP/1.1 Apr 11 17:06:03 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:06:03 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:06:03 user devstack@n-api.service[61424]: Connection: close Apr 11 17:06:03 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:06:03 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:06:03 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:06:03 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:06:03 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZLN5C3r7qxHCYsfNsZJQUAdRY5wI8VCDofVAqimoo4XNG7V9_HMkLefvPzrjpPnDVVcMX1ffLypXjoPCcogWkdMxBYDu4w2r1J4V8-Va5LRz4eXdBm_TfzpJ8wJDFQ4wJw4-nSjhZxqNdQ3diuVBNO7Wjt7zdjdGzE8TAF83jnimso Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Project-Id: 9e0fe3df39a64a39934d199c01985777 Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Project-Name: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e0fe3df39a64a39934d199c01985777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e0fe3df39a64a39934d199c01985777"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e0fe3df39a64a39934d199c01985777"}]}] Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Tenant: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Tenant-Id: 9e0fe3df39a64a39934d199c01985777 Apr 11 17:06:03 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:03 user devstack@n-api.service[61424]: X-User: tempest-DeleteServersTestJSON-1700911607-project-member Apr 11 17:06:03 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:06:03 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:06:03 user devstack@n-api.service[61424]: X-User-Id: c74611f9b01a45ef8cfbb50fa9b06cc8 Apr 11 17:06:03 user devstack@n-api.service[61424]: X-User-Name: tempest-DeleteServersTestJSON-1700911607-project-member Apr 11 17:06:03 user devstack@n-api.service[61424]: method: > Apr 11 17:06:03 user devstack@n-api.service[61424]: exception: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:03 user devstack@n-api.service[61424]: action_args: {'server_id': '6687cdc1-6ab3-4e6d-b4a4-e03772606c41'} Apr 11 17:06:03 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:03 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Returning 404 to user: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:03 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-3e3db7cf-d0c2-4181-bc47-a94899b0cdc8 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045126 Apr 11 17:06:03 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 70/203] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:06:03 2023] GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:03 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-65aa3a83-cbe4-4ef0-b0e5-3af253d1a2b7 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" status: 200 len: 2829 microversion: 2.42 time: 0.204333 Apr 11 17:06:03 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 68/204] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:06:02 2023] GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 => generated 2829 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:06:03 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-12c83207-a174-4f77-8a9b-231f07d33ebd tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:03 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-12c83207-a174-4f77-8a9b-231f07d33ebd tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12c83207-a174-4f77-8a9b-231f07d33ebd tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12c83207-a174-4f77-8a9b-231f07d33ebd tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12c83207-a174-4f77-8a9b-231f07d33ebd tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12c83207-a174-4f77-8a9b-231f07d33ebd tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12c83207-a174-4f77-8a9b-231f07d33ebd tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-12c83207-a174-4f77-8a9b-231f07d33ebd tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:03 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-12c83207-a174-4f77-8a9b-231f07d33ebd tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.132334 Apr 11 17:06:03 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 67/205] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 17:06:03 2023] GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1/os-interface => generated 1829 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:03 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:06:03 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-38edbd15-5aa5-4be8-aef0-0d818ef5c64f tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee" status: 204 len: 0 microversion: 2.32 time: 0.115204 Apr 11 17:06:03 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 71/206] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:06:03 2023] DELETE /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-54845357-8109-4655-98a7-47d54766b9f8 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-54845357-8109-4655-98a7-47d54766b9f8 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "tag": "dfdf099d-908f-40d1-937c-cfa70a5b38b5"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54845357-8109-4655-98a7-47d54766b9f8 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54845357-8109-4655-98a7-47d54766b9f8 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54845357-8109-4655-98a7-47d54766b9f8 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54845357-8109-4655-98a7-47d54766b9f8 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54845357-8109-4655-98a7-47d54766b9f8 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54845357-8109-4655-98a7-47d54766b9f8 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] Creating event network-changed:dfdf099d-908f-40d1-937c-cfa70a5b38b5 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-b9d2930c-b092-46c5-964f-8f5f47fc97a5 req-590dcb1c-e9ea-451b-85e9-45299301ade4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044045 Apr 11 17:06:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 72/207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-54845357-8109-4655-98a7-47d54766b9f8 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066145 Apr 11 17:06:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 68/208] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:06:04 2023] GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c1900a54-0d36-4ae1-840f-1415cd1ba1c6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c1900a54-0d36-4ae1-840f-1415cd1ba1c6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c1900a54-0d36-4ae1-840f-1415cd1ba1c6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c1900a54-0d36-4ae1-840f-1415cd1ba1c6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c1900a54-0d36-4ae1-840f-1415cd1ba1c6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c1900a54-0d36-4ae1-840f-1415cd1ba1c6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c1900a54-0d36-4ae1-840f-1415cd1ba1c6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c1900a54-0d36-4ae1-840f-1415cd1ba1c6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-3ee151a3-fe5e-43ef-ba22-95f4f23f4740 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-3ee151a3-fe5e-43ef-ba22-95f4f23f4740 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3ee151a3-fe5e-43ef-ba22-95f4f23f4740 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3ee151a3-fe5e-43ef-ba22-95f4f23f4740 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3ee151a3-fe5e-43ef-ba22-95f4f23f4740 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c1900a54-0d36-4ae1-840f-1415cd1ba1c6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073615 Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3ee151a3-fe5e-43ef-ba22-95f4f23f4740 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3ee151a3-fe5e-43ef-ba22-95f4f23f4740 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-3ee151a3-fe5e-43ef-ba22-95f4f23f4740 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 73/209] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:06:04 2023] GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG nova.objects.instance [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lazy-loading 'services' on Instance uuid 180c44cc-172d-4e8c-b4ec-6259e775c404 {{(pid=61424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-3ee151a3-fe5e-43ef-ba22-95f4f23f4740 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f7d3b94cc6b4a7d95489d7d4cf6e297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4085a617084465ae810ff06498f992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-3ee151a3-fe5e-43ef-ba22-95f4f23f4740 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790" status: 200 len: 1540 microversion: 2.1 time: 0.375113 Apr 11 17:06:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 69/210] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:06:04 2023] GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790 => generated 1540 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] HTTP exception thrown: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Request method failure captured: Apr 11 17:06:04 user devstack@n-api.service[61423]: request: DELETE /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41 HTTP/1.1 Apr 11 17:06:04 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:06:04 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:06:04 user devstack@n-api.service[61423]: Connection: close Apr 11 17:06:04 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:06:04 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:06:04 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:06:04 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:06:04 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLN5C3r7qxHCYsfNsZJQUAdRY5wI8VCDofVAqimoo4XNG7V9_HMkLefvPzrjpPnDVVcMX1ffLypXjoPCcogWkdMxBYDu4w2r1J4V8-Va5LRz4eXdBm_TfzpJ8wJDFQ4wJw4-nSjhZxqNdQ3diuVBNO7Wjt7zdjdGzE8TAF83jnimso Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Project-Id: 9e0fe3df39a64a39934d199c01985777 Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Project-Name: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e0fe3df39a64a39934d199c01985777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e0fe3df39a64a39934d199c01985777"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e0fe3df39a64a39934d199c01985777"}]}] Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Tenant: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Tenant-Id: 9e0fe3df39a64a39934d199c01985777 Apr 11 17:06:04 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:04 user devstack@n-api.service[61423]: X-User: tempest-DeleteServersTestJSON-1700911607-project-member Apr 11 17:06:04 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:06:04 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:06:04 user devstack@n-api.service[61423]: X-User-Id: c74611f9b01a45ef8cfbb50fa9b06cc8 Apr 11 17:06:04 user devstack@n-api.service[61423]: X-User-Name: tempest-DeleteServersTestJSON-1700911607-project-member Apr 11 17:06:04 user devstack@n-api.service[61423]: method: > Apr 11 17:06:04 user devstack@n-api.service[61423]: exception: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:04 user devstack@n-api.service[61423]: action_args: {'id': '6687cdc1-6ab3-4e6d-b4a4-e03772606c41'} Apr 11 17:06:04 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:04 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Returning 404 to user: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-25f9ad90-f086-43aa-b4a9-74ccc97039f3 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41" status: 404 len: 111 microversion: 2.1 time: 0.033249 Apr 11 17:06:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 70/211] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:06:04 2023] DELETE /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fda97057cf6440f8a117c8a01cde53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5ab1632b5534eb9b5096d25137bd538', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ae0ac1cd-a438-4f9e-9563-ed2fd4208213 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee" status: 200 len: 2940 microversion: 2.32 time: 0.847249 Apr 11 17:06:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 69/212] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:06:03 2023] GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee => generated 2940 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-unplugged", "status": "completed", "tag": "7320c7cb-cd67-4b96-bcd0-865515f9b472"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] Creating event network-vif-unplugged:7320c7cb-cd67-4b96-bcd0-865515f9b472 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-429b69eb-f940-4c8f-b969-ae8fa52bdac4 req-3189d91a-ea7e-4f46-831e-6875d52288bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038769 Apr 11 17:06:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 70/213] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-unplugged", "status": "completed", "tag": "a4c6824f-e5f7-4f25-81eb-5cc534c99636"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] Creating event network-vif-unplugged:a4c6824f-e5f7-4f25-81eb-5cc534c99636 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-db343587-f812-4533-bd18-8f325781e667 req-460cbf62-e906-4ebb-b0af-669ba9e3e970 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037615 Apr 11 17:06:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 71/214] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] [instance: 6687cdc1-6ab3-4e6d-b4a4-e03772606c41] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-1a1843e9-7c3e-4294-9baa-0836fadeef32 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments/1db9739e-54c3-4cb3-b225-7fb33f46160d" status: 202 len: 0 microversion: 2.1 time: 0.524017 Apr 11 17:06:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 74/215] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:06:04 2023] DELETE /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments/1db9739e-54c3-4cb3-b225-7fb33f46160d => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2f56c9d6-ff00-4e3a-b892-2f01ebce17fa tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-2f56c9d6-ff00-4e3a-b892-2f01ebce17fa tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] HTTP exception thrown: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Request method failure captured: Apr 11 17:06:04 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41 HTTP/1.1 Apr 11 17:06:04 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:06:04 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:06:04 user devstack@n-api.service[61422]: Connection: close Apr 11 17:06:04 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:06:04 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:06:04 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:06:04 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:06:04 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLN5C3r7qxHCYsfNsZJQUAdRY5wI8VCDofVAqimoo4XNG7V9_HMkLefvPzrjpPnDVVcMX1ffLypXjoPCcogWkdMxBYDu4w2r1J4V8-Va5LRz4eXdBm_TfzpJ8wJDFQ4wJw4-nSjhZxqNdQ3diuVBNO7Wjt7zdjdGzE8TAF83jnimso Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Project-Id: 9e0fe3df39a64a39934d199c01985777 Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Project-Name: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e0fe3df39a64a39934d199c01985777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e0fe3df39a64a39934d199c01985777"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e0fe3df39a64a39934d199c01985777"}]}] Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Tenant: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Tenant-Id: 9e0fe3df39a64a39934d199c01985777 Apr 11 17:06:04 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-DeleteServersTestJSON-1700911607 Apr 11 17:06:04 user devstack@n-api.service[61422]: X-User: tempest-DeleteServersTestJSON-1700911607-project-member Apr 11 17:06:04 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:06:04 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:06:04 user devstack@n-api.service[61422]: X-User-Id: c74611f9b01a45ef8cfbb50fa9b06cc8 Apr 11 17:06:04 user devstack@n-api.service[61422]: X-User-Name: tempest-DeleteServersTestJSON-1700911607-project-member Apr 11 17:06:04 user devstack@n-api.service[61422]: method: > Apr 11 17:06:04 user devstack@n-api.service[61422]: exception: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:04 user devstack@n-api.service[61422]: action_args: {'id': '6687cdc1-6ab3-4e6d-b4a4-e03772606c41'} Apr 11 17:06:04 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. Apr 11 17:06:04 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2f56c9d6-ff00-4e3a-b892-2f01ebce17fa tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2f56c9d6-ff00-4e3a-b892-2f01ebce17fa tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] Returning 404 to user: Instance 6687cdc1-6ab3-4e6d-b4a4-e03772606c41 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c1e23ee0-70e8-4bda-8f45-f61c5464b194 tempest-DeleteServersTestJSON-1700911607 tempest-DeleteServersTestJSON-1700911607-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41" status: 404 len: 111 microversion: 2.1 time: 0.049113 Apr 11 17:06:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 72/216] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:06:04 2023] GET /compute/v2.1/servers/6687cdc1-6ab3-4e6d-b4a4-e03772606c41 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2f56c9d6-ff00-4e3a-b892-2f01ebce17fa tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2f56c9d6-ff00-4e3a-b892-2f01ebce17fa tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2f56c9d6-ff00-4e3a-b892-2f01ebce17fa tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2f56c9d6-ff00-4e3a-b892-2f01ebce17fa tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-8fa382a3-c29f-4892-8fff-e4d06fb7fe2d tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" status: 204 len: 0 microversion: 2.42 time: 0.238688 Apr 11 17:06:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 71/217] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:06:04 2023] DELETE /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-2f56c9d6-ff00-4e3a-b892-2f01ebce17fa tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082460 Apr 11 17:06:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 75/218] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:06:04 2023] GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:05 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:05 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:05 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b2f35f746a2c41828b209a93f555993c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c144e1059e44b55bb7aa451b9547a75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-df1b2599-4eff-433f-8949-29fcd1e04d0c tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" status: 200 len: 2835 microversion: 2.42 time: 0.558148 Apr 11 17:06:05 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 73/219] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:06:04 2023] GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 => generated 2835 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:06:06 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-unplugged", "status": "completed", "tag": "51a3c765-0fbe-472f-bf1d-a49f663bdeea"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "51a3c765-0fbe-472f-bf1d-a49f663bdeea"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-unplugged", "status": "completed", "tag": "f73daf99-e281-41dc-87d9-f257045a8146"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:06 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:06 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:06 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:06 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Creating event network-vif-unplugged:51a3c765-0fbe-472f-bf1d-a49f663bdeea for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:06 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Creating event network-vif-plugged:51a3c765-0fbe-472f-bf1d-a49f663bdeea for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:06 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] Creating event network-vif-unplugged:f73daf99-e281-41dc-87d9-f257045a8146 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:06 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-1e1f2681-86b1-44d7-855e-88f12ef48e23 req-33a2549d-c7e9-49dc-a8de-2255a0219a9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.042104 Apr 11 17:06:06 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 72/220] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:06 2023] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:06 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "a4c6824f-e5f7-4f25-81eb-5cc534c99636"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-unplugged", "status": "completed", "tag": "818fbdc6-1f85-4f25-a9a8-99aec719102e"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "818fbdc6-1f85-4f25-a9a8-99aec719102e"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-unplugged", "status": "completed", "tag": "c6dc07d2-c1e5-44f7-8683-0162519e8613"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:06 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "7320c7cb-cd67-4b96-bcd0-865515f9b472"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-unplugged", "status": "completed", "tag": "8a27e645-0909-4786-a624-5d12630f2e1b"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "8a27e645-0909-4786-a624-5d12630f2e1b"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-unplugged", "status": "completed", "tag": "dfdf099d-908f-40d1-937c-cfa70a5b38b5"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "dfdf099d-908f-40d1-937c-cfa70a5b38b5"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:06 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:06 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:06 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:06 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:06 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:06 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:06 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Creating event network-vif-plugged:a4c6824f-e5f7-4f25-81eb-5cc534c99636 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:06 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Creating event network-vif-unplugged:818fbdc6-1f85-4f25-a9a8-99aec719102e for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:06 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Creating event network-vif-plugged:818fbdc6-1f85-4f25-a9a8-99aec719102e for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:06 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] Creating event network-vif-unplugged:c6dc07d2-c1e5-44f7-8683-0162519e8613 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:06 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-0bcdaec5-3c16-4e72-96a6-c3099656369e req-d56e055c-0c2c-4c47-9066-77cafa406e85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.044415 Apr 11 17:06:06 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 74/221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:06 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Creating event network-vif-plugged:7320c7cb-cd67-4b96-bcd0-865515f9b472 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Creating event network-vif-unplugged:8a27e645-0909-4786-a624-5d12630f2e1b for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Creating event network-vif-plugged:8a27e645-0909-4786-a624-5d12630f2e1b for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Creating event network-vif-unplugged:dfdf099d-908f-40d1-937c-cfa70a5b38b5 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] Creating event network-vif-plugged:dfdf099d-908f-40d1-937c-cfa70a5b38b5 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-d5955458-c72c-459d-bf97-39e6f435bf8e req-b0db02d3-f622-42ad-aaca-f4a17ee68b06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.061816 Apr 11 17:06:06 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 76/222] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:06 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:07 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5034b953-1e89-44c6-bdba-7c70ef8124a9"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:07 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:08 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-adbd2aa7-c14a-4956-96e0-1e4710814bcf tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334246 Apr 11 17:06:08 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 73/223] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:06:07 2023] POST /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:08 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "f73daf99-e281-41dc-87d9-f257045a8146"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-unplugged", "status": "completed", "tag": "0affebd5-561c-497c-9491-338dce8905e9"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "0affebd5-561c-497c-9491-338dce8905e9"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-unplugged", "status": "completed", "tag": "84d3c99c-9ae0-4d15-8338-ece1d9a04125"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "84d3c99c-9ae0-4d15-8338-ece1d9a04125"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-unplugged", "status": "completed", "tag": "50c39df9-0b72-4b14-96ca-356d0dc32f1c"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Creating event network-vif-plugged:f73daf99-e281-41dc-87d9-f257045a8146 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Creating event network-vif-unplugged:0affebd5-561c-497c-9491-338dce8905e9 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Creating event network-vif-plugged:0affebd5-561c-497c-9491-338dce8905e9 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Creating event network-vif-unplugged:84d3c99c-9ae0-4d15-8338-ece1d9a04125 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Creating event network-vif-plugged:84d3c99c-9ae0-4d15-8338-ece1d9a04125 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] Creating event network-vif-unplugged:50c39df9-0b72-4b14-96ca-356d0dc32f1c for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5ae81c38-b044-4ce0-8ff4-883175115c41 req-d71b6914-3e57-4753-96cc-e92ec72c5012 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1044 microversion: 2.1 time: 0.037948 Apr 11 17:06:08 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 75/224] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:08 2023] POST /compute/v2.1/os-server-external-events => generated 1044 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:06:08 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "c6dc07d2-c1e5-44f7-8683-0162519e8613"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-unplugged", "status": "completed", "tag": "99ac8a24-e783-4834-a419-d58b3e288aa4"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-plugged", "status": "completed", "tag": "99ac8a24-e783-4834-a419-d58b3e288aa4"}, {"name": "network-changed", "server_uuid": "9339e177-6264-4942-9dd1-372681209790", "tag": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:08 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-unplugged", "status": "completed", "tag": "39c10a5f-6007-4268-a337-da0f1c17c553"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "39c10a5f-6007-4268-a337-da0f1c17c553"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-unplugged", "status": "completed", "tag": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:08 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Creating event network-vif-plugged:c6dc07d2-c1e5-44f7-8683-0162519e8613 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:08 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Creating event network-vif-unplugged:99ac8a24-e783-4834-a419-d58b3e288aa4 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:08 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Creating event network-vif-plugged:99ac8a24-e783-4834-a419-d58b3e288aa4 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:08 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] Creating event network-changed:dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance 9339e177-6264-4942-9dd1-372681209790 on user Apr 11 17:06:08 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Creating event network-vif-unplugged:39c10a5f-6007-4268-a337-da0f1c17c553 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:08 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Creating event network-vif-plugged:39c10a5f-6007-4268-a337-da0f1c17c553 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:08 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Creating event network-vif-unplugged:9d81600b-d6e0-4715-9c00-f24f7a2d8fcb for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:08 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-9946051f-5a8b-44c5-8b85-56eb0807d9cc req-92d814cc-76fe-4daa-b62f-7bfd19510f41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 694 microversion: 2.1 time: 0.047141 Apr 11 17:06:08 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] Creating event network-vif-plugged:9d81600b-d6e0-4715-9c00-f24f7a2d8fcb for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:08 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 77/225] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:08 2023] POST /compute/v2.1/os-server-external-events => generated 694 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:08 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-9fca714d-2642-44c0-8eaa-9187ee7fdc84 req-1286bb9d-4a79-4ec8-bc0b-ed48a21e6c4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.037612 Apr 11 17:06:08 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 74/226] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:08 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "50c39df9-0b72-4b14-96ca-356d0dc32f1c"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] Creating event network-vif-plugged:50c39df9-0b72-4b14-96ca-356d0dc32f1c for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-89d7f822-8cca-40ba-9d14-18597a615120 req-020fc949-564c-4ca5-ab4d-30bffa42e64c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051774 Apr 11 17:06:10 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 76/227] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1291128519", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "f3262209-0a5c-4763-99ae-a8319122d98c"}]}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:10 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-013ab0f0-d5cb-4a12-8495-d0c567dfcbbe tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-013ab0f0-d5cb-4a12-8495-d0c567dfcbbe tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-013ab0f0-d5cb-4a12-8495-d0c567dfcbbe tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-013ab0f0-d5cb-4a12-8495-d0c567dfcbbe tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-013ab0f0-d5cb-4a12-8495-d0c567dfcbbe tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-013ab0f0-d5cb-4a12-8495-d0c567dfcbbe tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-013ab0f0-d5cb-4a12-8495-d0c567dfcbbe tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-013ab0f0-d5cb-4a12-8495-d0c567dfcbbe tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:10 user devstack@n-api.service[61424]: DEBUG nova.network.neutron [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] validate_networks() for [('f3262209-0a5c-4763-99ae-a8319122d98c', None, None, None, None, None)] {{(pid=61424) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:06:11 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-013ab0f0-d5cb-4a12-8495-d0c567dfcbbe tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-013ab0f0-d5cb-4a12-8495-d0c567dfcbbe tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 200 len: 1690 microversion: 2.1 time: 0.337632 Apr 11 17:06:11 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 75/228] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:06:10 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 1690 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting quotas for project 361d59e2f9ac4a68a1a738cc3f2a9d14. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting quotas for user 79b5fefb1e9748b8bf51535099bf5327 and project 361d59e2f9ac4a68a1a738cc3f2a9d14. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Going to run 1 instances... {{(pid=61424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:06:11 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:06:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-60c918c4-cda5-4206-b973-93d9ec92a0ac tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.884710 Apr 11 17:06:11 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 78/229] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 17:06:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 17:06:11 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-04aae941-6f94-4d7d-979b-3f20bbaaf7ce tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:11 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-04aae941-6f94-4d7d-979b-3f20bbaaf7ce tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:11 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-04aae941-6f94-4d7d-979b-3f20bbaaf7ce tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:11 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-04aae941-6f94-4d7d-979b-3f20bbaaf7ce tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:11 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-04aae941-6f94-4d7d-979b-3f20bbaaf7ce tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-04aae941-6f94-4d7d-979b-3f20bbaaf7ce tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02" status: 200 len: 1395 microversion: 2.87 time: 0.075194 Apr 11 17:06:11 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 77/230] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:06:11 2023] GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02 => generated 1395 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:06:11 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-c0ab749a-c3be-450b-a247-8356be4fc173 req-6388e370-e908-4110-a56d-99a962db37d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-deleted", "tag": "8a27e645-0909-4786-a624-5d12630f2e1b"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c0ab749a-c3be-450b-a247-8356be4fc173 req-6388e370-e908-4110-a56d-99a962db37d1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c0ab749a-c3be-450b-a247-8356be4fc173 req-6388e370-e908-4110-a56d-99a962db37d1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c0ab749a-c3be-450b-a247-8356be4fc173 req-6388e370-e908-4110-a56d-99a962db37d1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-c0ab749a-c3be-450b-a247-8356be4fc173 req-6388e370-e908-4110-a56d-99a962db37d1 service nova] Creating event network-vif-deleted:8a27e645-0909-4786-a624-5d12630f2e1b for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-c0ab749a-c3be-450b-a247-8356be4fc173 req-6388e370-e908-4110-a56d-99a962db37d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036583 Apr 11 17:06:11 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 76/231] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-4f79af8a-dc0c-45d2-b37f-cb5ee79fd500 req-c93bd35e-85cc-433c-8d89-e3d2f6b0d75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-deleted", "tag": "39c10a5f-6007-4268-a337-da0f1c17c553"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4f79af8a-dc0c-45d2-b37f-cb5ee79fd500 req-c93bd35e-85cc-433c-8d89-e3d2f6b0d75b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4f79af8a-dc0c-45d2-b37f-cb5ee79fd500 req-c93bd35e-85cc-433c-8d89-e3d2f6b0d75b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4f79af8a-dc0c-45d2-b37f-cb5ee79fd500 req-c93bd35e-85cc-433c-8d89-e3d2f6b0d75b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-4f79af8a-dc0c-45d2-b37f-cb5ee79fd500 req-c93bd35e-85cc-433c-8d89-e3d2f6b0d75b service nova] Creating event network-vif-deleted:39c10a5f-6007-4268-a337-da0f1c17c553 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-4f79af8a-dc0c-45d2-b37f-cb5ee79fd500 req-c93bd35e-85cc-433c-8d89-e3d2f6b0d75b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076077 Apr 11 17:06:12 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 79/232] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-deleted", "tag": "51a3c765-0fbe-472f-bf1d-a49f663bdeea"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-deleted", "tag": "c6dc07d2-c1e5-44f7-8683-0162519e8613"}, {"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-deleted", "tag": "7320c7cb-cd67-4b96-bcd0-865515f9b472"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] Creating event network-vif-deleted:51a3c765-0fbe-472f-bf1d-a49f663bdeea for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] Creating event network-vif-deleted:c6dc07d2-c1e5-44f7-8683-0162519e8613 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] Creating event network-vif-deleted:7320c7cb-cd67-4b96-bcd0-865515f9b472 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-7b13963b-c055-4d15-96f8-47c4e606caab req-b0824498-92a8-43a0-972f-56ce7111df49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056338 Apr 11 17:06:13 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 78/233] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:13 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:14 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-deleted", "tag": "dfdf099d-908f-40d1-937c-cfa70a5b38b5"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-deleted", "tag": "84d3c99c-9ae0-4d15-8338-ece1d9a04125"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:14 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] Creating event network-vif-deleted:dfdf099d-908f-40d1-937c-cfa70a5b38b5 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:14 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] Creating event network-vif-deleted:84d3c99c-9ae0-4d15-8338-ece1d9a04125 for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:14 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-502e2cb9-2c69-466e-8c71-8517bf5a72f9 req-ea5163d8-b4c1-40fc-8310-4e82b617daea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042188 Apr 11 17:06:14 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 77/234] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:14 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:14 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] Creating event network-changed:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:06:14 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-9c61828f-8bf5-4b0b-963f-3981449ecac4 req-d55daa47-f8f3-4dfd-a78c-7dd2f7e8dd5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041467 Apr 11 17:06:14 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 80/235] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:15 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5524c919-4e36-4b27-8958-036740dc5f61 req-c8aa830e-9a40-4beb-bed0-35c55a8eaf05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b822b32-bf4e-43e4-9024-32318a7db4ee", "name": "network-vif-deleted", "tag": "99ac8a24-e783-4834-a419-d58b3e288aa4"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5524c919-4e36-4b27-8958-036740dc5f61 req-c8aa830e-9a40-4beb-bed0-35c55a8eaf05 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5524c919-4e36-4b27-8958-036740dc5f61 req-c8aa830e-9a40-4beb-bed0-35c55a8eaf05 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5524c919-4e36-4b27-8958-036740dc5f61 req-c8aa830e-9a40-4beb-bed0-35c55a8eaf05 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5524c919-4e36-4b27-8958-036740dc5f61 req-c8aa830e-9a40-4beb-bed0-35c55a8eaf05 service nova] Creating event network-vif-deleted:99ac8a24-e783-4834-a419-d58b3e288aa4 for instance 4b822b32-bf4e-43e4-9024-32318a7db4ee on user Apr 11 17:06:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5524c919-4e36-4b27-8958-036740dc5f61 req-c8aa830e-9a40-4beb-bed0-35c55a8eaf05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040112 Apr 11 17:06:15 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 79/236] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:16 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-21eedeb8-184b-4318-b3c5-b32f0b59f77b req-966f5e4f-b2bf-49ba-8e76-1b233717784c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-deleted", "tag": "9d81600b-d6e0-4715-9c00-f24f7a2d8fcb"}, {"server_uuid": "fc8f8805-6d61-45a5-b56f-d2c0b107e9c1", "name": "network-vif-deleted", "tag": "50c39df9-0b72-4b14-96ca-356d0dc32f1c"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-21eedeb8-184b-4318-b3c5-b32f0b59f77b req-966f5e4f-b2bf-49ba-8e76-1b233717784c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-21eedeb8-184b-4318-b3c5-b32f0b59f77b req-966f5e4f-b2bf-49ba-8e76-1b233717784c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-21eedeb8-184b-4318-b3c5-b32f0b59f77b req-966f5e4f-b2bf-49ba-8e76-1b233717784c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:16 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-21eedeb8-184b-4318-b3c5-b32f0b59f77b req-966f5e4f-b2bf-49ba-8e76-1b233717784c service nova] Creating event network-vif-deleted:9d81600b-d6e0-4715-9c00-f24f7a2d8fcb for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:16 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-21eedeb8-184b-4318-b3c5-b32f0b59f77b req-966f5e4f-b2bf-49ba-8e76-1b233717784c service nova] Creating event network-vif-deleted:50c39df9-0b72-4b14-96ca-356d0dc32f1c for instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 on user Apr 11 17:06:16 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-21eedeb8-184b-4318-b3c5-b32f0b59f77b req-966f5e4f-b2bf-49ba-8e76-1b233717784c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050899 Apr 11 17:06:16 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 78/237] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:16 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:16 user devstack@n-api.service[61424]: DEBUG nova.objects.instance [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'services' on Instance uuid 9339e177-6264-4942-9dd1-372681209790 {{(pid=61424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:06:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-82fa3525-915d-4908-9a28-470eaabc6c34 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/os-volume_attachments/5034b953-1e89-44c6-bdba-7c70ef8124a9" status: 202 len: 0 microversion: 2.1 time: 0.188628 Apr 11 17:06:16 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 81/238] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:06:16 2023] DELETE /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/os-volume_attachments/5034b953-1e89-44c6-bdba-7c70ef8124a9 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:06:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9d6f01d3-cf5d-4291-a14a-0f78587e8b50 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:16 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9d6f01d3-cf5d-4291-a14a-0f78587e8b50 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d6f01d3-cf5d-4291-a14a-0f78587e8b50 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d6f01d3-cf5d-4291-a14a-0f78587e8b50 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d6f01d3-cf5d-4291-a14a-0f78587e8b50 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d6f01d3-cf5d-4291-a14a-0f78587e8b50 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d6f01d3-cf5d-4291-a14a-0f78587e8b50 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9d6f01d3-cf5d-4291-a14a-0f78587e8b50 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9d6f01d3-cf5d-4291-a14a-0f78587e8b50 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046072 Apr 11 17:06:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 80/239] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:06:16 2023] GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-48b70f50-2afd-4627-bb50-9019375503b7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-48b70f50-2afd-4627-bb50-9019375503b7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-48b70f50-2afd-4627-bb50-9019375503b7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-48b70f50-2afd-4627-bb50-9019375503b7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-48b70f50-2afd-4627-bb50-9019375503b7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-48b70f50-2afd-4627-bb50-9019375503b7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-48b70f50-2afd-4627-bb50-9019375503b7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-48b70f50-2afd-4627-bb50-9019375503b7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:22 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-48b70f50-2afd-4627-bb50-9019375503b7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114385 Apr 11 17:06:22 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 79/240] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:06:22 2023] GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:06:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] HTTP exception thrown: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Request method failure captured: Apr 11 17:06:22 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783 HTTP/1.1 Apr 11 17:06:22 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:06:22 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:06:22 user devstack@n-api.service[61424]: Connection: close Apr 11 17:06:22 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:06:22 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:06:22 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:06:22 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:06:22 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZK9qNA_DdQy9OfdGGLP9gidMh3Rliz-HCNdP3_jS5RUQTgcczgxBHmNKfpKiTQYKbvHdBBbrmcYEh-FHcGGOpSE1xoH-Hag1OPVhAdiumjweUSlOP5mDUuS4JYJGp_E-qhs6GIkrokRHFq6IC26cjdTbGvcOUlLLpWZG9PvIrfKHmM Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Project-Id: 7c7d76a8d4544e2b84d52eebb6d4b5b1 Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1826674867 Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c7d76a8d4544e2b84d52eebb6d4b5b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c7d76a8d4544e2b84d52eebb6d4b5b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c7d76a8d4544e2b84d52eebb6d4b5b1"}]}] Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1826674867 Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Tenant-Id: 7c7d76a8d4544e2b84d52eebb6d4b5b1 Apr 11 17:06:22 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1826674867 Apr 11 17:06:22 user devstack@n-api.service[61424]: X-User: tempest-AttachSCSIVolumeTestJSON-1826674867-project-member Apr 11 17:06:22 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:06:22 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:06:22 user devstack@n-api.service[61424]: X-User-Id: 1c4b1a17c7804cd4ba2ad825e0cc2dd0 Apr 11 17:06:22 user devstack@n-api.service[61424]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1826674867-project-member Apr 11 17:06:22 user devstack@n-api.service[61424]: method: > Apr 11 17:06:22 user devstack@n-api.service[61424]: exception: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:22 user devstack@n-api.service[61424]: action_args: {'id': 'cdd4a3a0-35a6-4f62-abc1-6a806ab62783'} Apr 11 17:06:22 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:22 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:22 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Returning 404 to user: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-534aba3c-1071-4b6f-bddd-49ad6484148f tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783" status: 404 len: 111 microversion: 2.1 time: 0.094634 Apr 11 17:06:22 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 82/241] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:06:22 2023] GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:06:22 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6f68de1b-75dc-424b-beb0-a9c9e300acaf tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '.version_select at 0x7f5bdd92ab90>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:22 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:22 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=41 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-6f68de1b-75dc-424b-beb0-a9c9e300acaf tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208324507" status: 202 len: 0 microversion: 2.1 time: 0.045922 Apr 11 17:06:22 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 81/242] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 17:06:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208324507 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1508615167", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "3d6cedad-ded5-40a1-b6c1-beeb84619510"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:22 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] validate_networks() for [('3d6cedad-ded5-40a1-b6c1-beeb84619510', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Getting quotas for project 381738c7ad99437b875807c4252965bf. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Getting quotas for user d111d892e2944f279a36622978b2dd06 and project 381738c7ad99437b875807c4252965bf. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:06:23 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:06:23 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-411d18c2-d021-4f97-8986-14baad2ed03d tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.107070 Apr 11 17:06:23 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 80/243] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:06:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:06:23 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ee44a3c3-ed3a-411e-83ba-afd499b39c5c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:23 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-ee44a3c3-ed3a-411e-83ba-afd499b39c5c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:23 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-ee44a3c3-ed3a-411e-83ba-afd499b39c5c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd111d892e2944f279a36622978b2dd06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381738c7ad99437b875807c4252965bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:23 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ee44a3c3-ed3a-411e-83ba-afd499b39c5c tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" status: 200 len: 1212 microversion: 2.1 time: 0.105491 Apr 11 17:06:23 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 83/244] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:06:23 2023] GET /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b => generated 1212 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:06:24 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:24 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:24 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:24 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] HTTP exception thrown: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:24 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Request method failure captured: Apr 11 17:06:24 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783 HTTP/1.1 Apr 11 17:06:24 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:06:24 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:06:24 user devstack@n-api.service[61422]: Connection: close Apr 11 17:06:24 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:06:24 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:06:24 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:06:24 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:06:24 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZK9qNA_DdQy9OfdGGLP9gidMh3Rliz-HCNdP3_jS5RUQTgcczgxBHmNKfpKiTQYKbvHdBBbrmcYEh-FHcGGOpSE1xoH-Hag1OPVhAdiumjweUSlOP5mDUuS4JYJGp_E-qhs6GIkrokRHFq6IC26cjdTbGvcOUlLLpWZG9PvIrfKHmM Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Project-Id: 7c7d76a8d4544e2b84d52eebb6d4b5b1 Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1826674867 Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c7d76a8d4544e2b84d52eebb6d4b5b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c7d76a8d4544e2b84d52eebb6d4b5b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c7d76a8d4544e2b84d52eebb6d4b5b1"}]}] Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1826674867 Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Tenant-Id: 7c7d76a8d4544e2b84d52eebb6d4b5b1 Apr 11 17:06:24 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1826674867 Apr 11 17:06:24 user devstack@n-api.service[61422]: X-User: tempest-AttachSCSIVolumeTestJSON-1826674867-project-member Apr 11 17:06:24 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:06:24 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:06:24 user devstack@n-api.service[61422]: X-User-Id: 1c4b1a17c7804cd4ba2ad825e0cc2dd0 Apr 11 17:06:24 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1826674867-project-member Apr 11 17:06:24 user devstack@n-api.service[61422]: method: > Apr 11 17:06:24 user devstack@n-api.service[61422]: exception: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:24 user devstack@n-api.service[61422]: action_args: {'id': 'cdd4a3a0-35a6-4f62-abc1-6a806ab62783'} Apr 11 17:06:24 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:24 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Returning 404 to user: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:24 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7df0a267-d933-4458-a523-57788d1fee80 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783" status: 404 len: 111 microversion: 2.1 time: 0.039494 Apr 11 17:06:24 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 82/245] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:06:24 2023] DELETE /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:06:24 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:24 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] [instance: cdd4a3a0-35a6-4f62-abc1-6a806ab62783] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:24 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:24 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:24 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:24 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:24 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:24 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:24 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] HTTP exception thrown: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:24 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Request method failure captured: Apr 11 17:06:24 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783 HTTP/1.1 Apr 11 17:06:24 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:06:24 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:06:24 user devstack@n-api.service[61423]: Connection: close Apr 11 17:06:24 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:06:24 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:06:24 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:06:24 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:06:24 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZK9qNA_DdQy9OfdGGLP9gidMh3Rliz-HCNdP3_jS5RUQTgcczgxBHmNKfpKiTQYKbvHdBBbrmcYEh-FHcGGOpSE1xoH-Hag1OPVhAdiumjweUSlOP5mDUuS4JYJGp_E-qhs6GIkrokRHFq6IC26cjdTbGvcOUlLLpWZG9PvIrfKHmM Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Project-Id: 7c7d76a8d4544e2b84d52eebb6d4b5b1 Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1826674867 Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c7d76a8d4544e2b84d52eebb6d4b5b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c7d76a8d4544e2b84d52eebb6d4b5b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c7d76a8d4544e2b84d52eebb6d4b5b1"}]}] Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1826674867 Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Tenant-Id: 7c7d76a8d4544e2b84d52eebb6d4b5b1 Apr 11 17:06:24 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1826674867 Apr 11 17:06:24 user devstack@n-api.service[61423]: X-User: tempest-AttachSCSIVolumeTestJSON-1826674867-project-member Apr 11 17:06:24 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:06:24 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:06:24 user devstack@n-api.service[61423]: X-User-Id: 1c4b1a17c7804cd4ba2ad825e0cc2dd0 Apr 11 17:06:24 user devstack@n-api.service[61423]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1826674867-project-member Apr 11 17:06:24 user devstack@n-api.service[61423]: method: > Apr 11 17:06:24 user devstack@n-api.service[61423]: exception: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:24 user devstack@n-api.service[61423]: action_args: {'id': 'cdd4a3a0-35a6-4f62-abc1-6a806ab62783'} Apr 11 17:06:24 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. Apr 11 17:06:24 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:24 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] Returning 404 to user: Instance cdd4a3a0-35a6-4f62-abc1-6a806ab62783 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:24 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-84a0fb2f-a3b5-49d8-a5e5-b32f7ba6fdf5 tempest-AttachSCSIVolumeTestJSON-1826674867 tempest-AttachSCSIVolumeTestJSON-1826674867-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783" status: 404 len: 111 microversion: 2.1 time: 0.037440 Apr 11 17:06:24 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 81/246] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:06:24 2023] GET /compute/v2.1/servers/cdd4a3a0-35a6-4f62-abc1-6a806ab62783 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:06:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b", "tag": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] Creating event network-changed:84508dcf-4b2a-4a8c-807f-12f73bf1fa0f for instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b on user Apr 11 17:06:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-8f5a71af-f21d-42cb-8a4d-db7b75861bc9 req-ef4330b9-eafe-4d74-a569-94c4f1d9ed88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110821 Apr 11 17:06:26 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 84/247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:26 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-plugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] Creating event network-vif-plugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:06:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-1471969e-4678-43a7-a1b5-8b6667b4277e req-a5e10d4b-8919-47ef-8e78-1320676a99fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031049 Apr 11 17:06:26 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 83/248] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:29 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-plugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:29 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] Creating event network-vif-plugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:06:29 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-e078a4f5-3989-480a-bb5a-8dcd758d570c req-84fb0057-df62-414b-bdcd-a002ccff04d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037883 Apr 11 17:06:29 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 82/249] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:29 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b", "name": "network-vif-plugged", "status": "completed", "tag": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:29 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] Creating event network-vif-plugged:84508dcf-4b2a-4a8c-807f-12f73bf1fa0f for instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b on user Apr 11 17:06:29 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-65292624-4768-4612-a51e-529d72e2a1c9 req-a0d3552d-b402-4070-939b-acb25c824f28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032616 Apr 11 17:06:29 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 85/250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b", "name": "network-vif-plugged", "status": "completed", "tag": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] Creating event network-vif-plugged:84508dcf-4b2a-4a8c-807f-12f73bf1fa0f for instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b on user Apr 11 17:06:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-0f3cf838-6391-4e27-a681-83185991f1c1 req-9dfe3a83-6688-4f4d-9b6e-2158fb04385d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032116 Apr 11 17:06:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 84/251] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:34 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:34 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:34 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ca204f43-c654-4a8f-a4ec-c217fcf5fce6 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd9c3640>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1790226833", "metadata": {"Type": "work"}}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:34 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ca204f43-c654-4a8f-a4ec-c217fcf5fce6 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Request method failure captured: Apr 11 17:06:34 user devstack@n-api.service[61423]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 17:06:34 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:06:34 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:06:34 user devstack@n-api.service[61423]: Connection: close Apr 11 17:06:34 user devstack@n-api.service[61423]: Content-Length: 122 Apr 11 17:06:34 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:06:34 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:06:34 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:06:34 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZOaEZieh2dSuASp4Vl__2jL5FSmBmmyKXx8bl_48DYH_pCqjcWcqe6TRomltqL5EQdRST4zqw2yBrHgPPl0aY5NlKCokhZSNqeXvZUmaxvvqE0Nb1UY3KI5r8ECJgdl8LiB1ENQDv7dviMYgVYADRII3sL9ZLoIrKFFfl-tWo_R2s8 Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Project-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Project-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}] Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Tenant: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Tenant-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:34 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:34 user devstack@n-api.service[61423]: X-User: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:34 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:06:34 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:06:34 user devstack@n-api.service[61423]: X-User-Id: 379d9818f17d4dfb97398cb299b9b5a4 Apr 11 17:06:34 user devstack@n-api.service[61423]: X-User-Name: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:34 user devstack@n-api.service[61423]: Apr 11 17:06:34 user devstack@n-api.service[61423]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1790226833", "metadata": {"Type": "work"}}} Apr 11 17:06:34 user devstack@n-api.service[61423]: method: Apr 11 17:06:34 user devstack@n-api.service[61423]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 17:06:34 user devstack@n-api.service[61423]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1790226833', 'metadata': {'Type': 'work'}}}} Apr 11 17:06:34 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise error Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi '#$%' Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 17:06:34 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ca204f43-c654-4a8f-a4ec-c217fcf5fce6 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:34 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ca204f43-c654-4a8f-a4ec-c217fcf5fce6 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.200499 Apr 11 17:06:34 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 83/252] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 17:06:34 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:06:34 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:34 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-623945a9-a0a6-46aa-830d-87c3692a7ab3 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Action: 'create', calling method: .version_select at 0x7f5bddeafbe0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-165712949", "metadata": {"Type": "work"}}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:34 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-623945a9-a0a6-46aa-830d-87c3692a7ab3 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Request method failure captured: Apr 11 17:06:34 user devstack@n-api.service[61424]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 17:06:34 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:06:34 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:06:34 user devstack@n-api.service[61424]: Connection: close Apr 11 17:06:34 user devstack@n-api.service[61424]: Content-Length: 119 Apr 11 17:06:34 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:06:34 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:06:34 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:06:34 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZOaEZieh2dSuASp4Vl__2jL5FSmBmmyKXx8bl_48DYH_pCqjcWcqe6TRomltqL5EQdRST4zqw2yBrHgPPl0aY5NlKCokhZSNqeXvZUmaxvvqE0Nb1UY3KI5r8ECJgdl8LiB1ENQDv7dviMYgVYADRII3sL9ZLoIrKFFfl-tWo_R2s8 Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Project-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Project-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}] Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Tenant: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Tenant-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:34 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:34 user devstack@n-api.service[61424]: X-User: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:34 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:06:34 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:06:34 user devstack@n-api.service[61424]: X-User-Id: 379d9818f17d4dfb97398cb299b9b5a4 Apr 11 17:06:34 user devstack@n-api.service[61424]: X-User-Name: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:34 user devstack@n-api.service[61424]: Apr 11 17:06:34 user devstack@n-api.service[61424]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-165712949", "metadata": {"Type": "work"}}} Apr 11 17:06:34 user devstack@n-api.service[61424]: method: Apr 11 17:06:34 user devstack@n-api.service[61424]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 17:06:34 user devstack@n-api.service[61424]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-165712949', 'metadata': {'Type': 'work'}}}} Apr 11 17:06:34 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise error Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi '0' Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 17:06:34 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-623945a9-a0a6-46aa-830d-87c3692a7ab3 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:34 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-623945a9-a0a6-46aa-830d-87c3692a7ab3 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012777 Apr 11 17:06:34 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 86/253] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 17:06:34 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:06:34 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-815e62c0-4bbf-401a-a4fc-8a90b42c7f8a tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd92b2e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1298941731", "metadata": {"Type": "work"}}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:34 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-815e62c0-4bbf-401a-a4fc-8a90b42c7f8a tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Request method failure captured: Apr 11 17:06:34 user devstack@n-api.service[61422]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 17:06:34 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:06:34 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:06:34 user devstack@n-api.service[61422]: Connection: close Apr 11 17:06:34 user devstack@n-api.service[61422]: Content-Length: 119 Apr 11 17:06:34 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:06:34 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:06:34 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:06:34 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZOaEZieh2dSuASp4Vl__2jL5FSmBmmyKXx8bl_48DYH_pCqjcWcqe6TRomltqL5EQdRST4zqw2yBrHgPPl0aY5NlKCokhZSNqeXvZUmaxvvqE0Nb1UY3KI5r8ECJgdl8LiB1ENQDv7dviMYgVYADRII3sL9ZLoIrKFFfl-tWo_R2s8 Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Project-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Project-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}] Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Tenant: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Tenant-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:34 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:34 user devstack@n-api.service[61422]: X-User: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:34 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:06:34 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:06:34 user devstack@n-api.service[61422]: X-User-Id: 379d9818f17d4dfb97398cb299b9b5a4 Apr 11 17:06:34 user devstack@n-api.service[61422]: X-User-Name: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:34 user devstack@n-api.service[61422]: Apr 11 17:06:34 user devstack@n-api.service[61422]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1298941731", "metadata": {"Type": "work"}}} Apr 11 17:06:34 user devstack@n-api.service[61422]: method: Apr 11 17:06:34 user devstack@n-api.service[61422]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 17:06:34 user devstack@n-api.service[61422]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1298941731', 'metadata': {'Type': 'work'}}}} Apr 11 17:06:34 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise error Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi '' Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 17:06:34 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:34 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-815e62c0-4bbf-401a-a4fc-8a90b42c7f8a tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-815e62c0-4bbf-401a-a4fc-8a90b42c7f8a tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013823 Apr 11 17:06:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 85/254] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 17:06:34 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:06:34 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-192e0079-15c3-4353-9b7e-ba284629b52e tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Calling method '.version_select at 0x7f5bdd9c3f40>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:35 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-192e0079-15c3-4353-9b7e-ba284629b52e tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] HTTP exception thrown: Volume tempest-invalid-912732946 could not be found. Apr 11 17:06:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-192e0079-15c3-4353-9b7e-ba284629b52e tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Request method failure captured: Apr 11 17:06:35 user devstack@n-api.service[61423]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-912732946 HTTP/1.1 Apr 11 17:06:35 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:06:35 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:06:35 user devstack@n-api.service[61423]: Connection: close Apr 11 17:06:35 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:06:35 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:06:35 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:06:35 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:06:35 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZOaEZieh2dSuASp4Vl__2jL5FSmBmmyKXx8bl_48DYH_pCqjcWcqe6TRomltqL5EQdRST4zqw2yBrHgPPl0aY5NlKCokhZSNqeXvZUmaxvvqE0Nb1UY3KI5r8ECJgdl8LiB1ENQDv7dviMYgVYADRII3sL9ZLoIrKFFfl-tWo_R2s8 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Project-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Project-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}] Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Tenant: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Tenant-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-User: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:35 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:06:35 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:06:35 user devstack@n-api.service[61423]: X-User-Id: 379d9818f17d4dfb97398cb299b9b5a4 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-User-Name: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:35 user devstack@n-api.service[61423]: method: Apr 11 17:06:35 user devstack@n-api.service[61423]: exception: Volume tempest-invalid-912732946 could not be found. Apr 11 17:06:35 user devstack@n-api.service[61423]: action_args: {'id': 'tempest-invalid-912732946'} Apr 11 17:06:35 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-912732946 could not be found. (HTTP 404) (Request-ID: req-b3c8b6c6-5e49-4361-872b-9b341c5bd926) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-912732946 could not be found. Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-912732946 could not be found. Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-912732946 could not be found. Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-192e0079-15c3-4353-9b7e-ba284629b52e tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Returning 404 to user: Volume tempest-invalid-912732946 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:35 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-192e0079-15c3-4353-9b7e-ba284629b52e tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-912732946" status: 404 len: 98 microversion: 2.1 time: 0.045563 Apr 11 17:06:35 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 84/255] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 11 17:06:34 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-912732946 => generated 98 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 11 17:06:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ccc2fd6e-3488-41d5-adeb-80ec6907c136 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003972 Apr 11 17:06:35 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 87/256] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 17:06:35 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 17:06:35 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c5bdcbfd-c29c-4258-99da-843e748ee127 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004028 Apr 11 17:06:35 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 86/257] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 11 17:06:35 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 17:06:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-9ed7f944-1f3d-4755-9313-2dd9f24607a0 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Calling method '.version_select at 0x7f5bdd9c0670>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:35 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-9ed7f944-1f3d-4755-9313-2dd9f24607a0 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] HTTP exception thrown: Volume 070955f2-e834-4c48-a5cc-f61cd5acf40f could not be found. Apr 11 17:06:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-9ed7f944-1f3d-4755-9313-2dd9f24607a0 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Request method failure captured: Apr 11 17:06:35 user devstack@n-api.service[61423]: request: DELETE /compute/v2.1/os-volumes/070955f2-e834-4c48-a5cc-f61cd5acf40f HTTP/1.1 Apr 11 17:06:35 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:06:35 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:06:35 user devstack@n-api.service[61423]: Connection: close Apr 11 17:06:35 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:06:35 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:06:35 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:06:35 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:06:35 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZOaEZieh2dSuASp4Vl__2jL5FSmBmmyKXx8bl_48DYH_pCqjcWcqe6TRomltqL5EQdRST4zqw2yBrHgPPl0aY5NlKCokhZSNqeXvZUmaxvvqE0Nb1UY3KI5r8ECJgdl8LiB1ENQDv7dviMYgVYADRII3sL9ZLoIrKFFfl-tWo_R2s8 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Project-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Project-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}] Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Tenant: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Tenant-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:35 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-User: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:35 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:06:35 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:06:35 user devstack@n-api.service[61423]: X-User-Id: 379d9818f17d4dfb97398cb299b9b5a4 Apr 11 17:06:35 user devstack@n-api.service[61423]: X-User-Name: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:35 user devstack@n-api.service[61423]: method: Apr 11 17:06:35 user devstack@n-api.service[61423]: exception: Volume 070955f2-e834-4c48-a5cc-f61cd5acf40f could not be found. Apr 11 17:06:35 user devstack@n-api.service[61423]: action_args: {'id': '070955f2-e834-4c48-a5cc-f61cd5acf40f'} Apr 11 17:06:35 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 070955f2-e834-4c48-a5cc-f61cd5acf40f could not be found. (HTTP 404) (Request-ID: req-58a26170-e308-4d6c-965f-04a129aacfab) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 070955f2-e834-4c48-a5cc-f61cd5acf40f could not be found. Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 070955f2-e834-4c48-a5cc-f61cd5acf40f could not be found. Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 070955f2-e834-4c48-a5cc-f61cd5acf40f could not be found. Apr 11 17:06:35 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-9ed7f944-1f3d-4755-9313-2dd9f24607a0 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Returning 404 to user: Volume 070955f2-e834-4c48-a5cc-f61cd5acf40f could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:35 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-9ed7f944-1f3d-4755-9313-2dd9f24607a0 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/070955f2-e834-4c48-a5cc-f61cd5acf40f" status: 404 len: 109 microversion: 2.1 time: 0.036259 Apr 11 17:06:35 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 85/258] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 17:06:35 2023] DELETE /compute/v2.1/os-volumes/070955f2-e834-4c48-a5cc-f61cd5acf40f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:06:35 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-198669f0-9cb1-49f7-a326-d62a900d8904 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Calling method '.version_select at 0x7f5bdea572e0>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-198669f0-9cb1-49f7-a326-d62a900d8904 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] HTTP exception thrown: Volume 8c70e656-1b14-462c-a768-9bf50abcd5e1 could not be found. Apr 11 17:06:35 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-198669f0-9cb1-49f7-a326-d62a900d8904 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Request method failure captured: Apr 11 17:06:35 user devstack@n-api.service[61424]: request: GET /compute/v2.1/os-volumes/8c70e656-1b14-462c-a768-9bf50abcd5e1 HTTP/1.1 Apr 11 17:06:35 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:06:35 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:06:35 user devstack@n-api.service[61424]: Connection: close Apr 11 17:06:35 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:06:35 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:06:35 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:06:35 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:06:35 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZOaEZieh2dSuASp4Vl__2jL5FSmBmmyKXx8bl_48DYH_pCqjcWcqe6TRomltqL5EQdRST4zqw2yBrHgPPl0aY5NlKCokhZSNqeXvZUmaxvvqE0Nb1UY3KI5r8ECJgdl8LiB1ENQDv7dviMYgVYADRII3sL9ZLoIrKFFfl-tWo_R2s8 Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Project-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Project-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a7833c2f7bc4d96898b323785809a6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a7833c2f7bc4d96898b323785809a6b"}]}] Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Tenant: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Tenant-Id: 2a7833c2f7bc4d96898b323785809a6b Apr 11 17:06:35 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-VolumesNegativeTest-9310195 Apr 11 17:06:35 user devstack@n-api.service[61424]: X-User: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:35 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:06:35 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:06:35 user devstack@n-api.service[61424]: X-User-Id: 379d9818f17d4dfb97398cb299b9b5a4 Apr 11 17:06:35 user devstack@n-api.service[61424]: X-User-Name: tempest-VolumesNegativeTest-9310195-project-member Apr 11 17:06:35 user devstack@n-api.service[61424]: method: Apr 11 17:06:35 user devstack@n-api.service[61424]: exception: Volume 8c70e656-1b14-462c-a768-9bf50abcd5e1 could not be found. Apr 11 17:06:35 user devstack@n-api.service[61424]: action_args: {'id': '8c70e656-1b14-462c-a768-9bf50abcd5e1'} Apr 11 17:06:35 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8c70e656-1b14-462c-a768-9bf50abcd5e1 could not be found. (HTTP 404) (Request-ID: req-b2712d73-c70b-47ab-ac6c-a9e06a551fbd) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8c70e656-1b14-462c-a768-9bf50abcd5e1 could not be found. Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8c70e656-1b14-462c-a768-9bf50abcd5e1 could not be found. Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8c70e656-1b14-462c-a768-9bf50abcd5e1 could not be found. Apr 11 17:06:35 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:35 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-198669f0-9cb1-49f7-a326-d62a900d8904 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] Returning 404 to user: Volume 8c70e656-1b14-462c-a768-9bf50abcd5e1 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-198669f0-9cb1-49f7-a326-d62a900d8904 tempest-VolumesNegativeTest-9310195 tempest-VolumesNegativeTest-9310195-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8c70e656-1b14-462c-a768-9bf50abcd5e1" status: 404 len: 109 microversion: 2.1 time: 0.043134 Apr 11 17:06:35 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 88/259] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:06:35 2023] GET /compute/v2.1/os-volumes/8c70e656-1b14-462c-a768-9bf50abcd5e1 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:06:50 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:50 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=5 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:50 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5279edd2-16fb-4f8f-84fa-68a6af22261e tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:50 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-5279edd2-16fb-4f8f-84fa-68a6af22261e tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5279edd2-16fb-4f8f-84fa-68a6af22261e tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5279edd2-16fb-4f8f-84fa-68a6af22261e tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5279edd2-16fb-4f8f-84fa-68a6af22261e tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5279edd2-16fb-4f8f-84fa-68a6af22261e tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5279edd2-16fb-4f8f-84fa-68a6af22261e tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5279edd2-16fb-4f8f-84fa-68a6af22261e tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:50 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-5279edd2-16fb-4f8f-84fa-68a6af22261e tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:50 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-5279edd2-16fb-4f8f-84fa-68a6af22261e tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c" status: 200 len: 1504 microversion: 2.1 time: 0.180900 Apr 11 17:06:50 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 87/260] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:06:50 2023] GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:06:53 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:53 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=11 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:53 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e7d981fb-34e9-4d88-ae81-da14949aa7c5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:53 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e7d981fb-34e9-4d88-ae81-da14949aa7c5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7d981fb-34e9-4d88-ae81-da14949aa7c5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7d981fb-34e9-4d88-ae81-da14949aa7c5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7d981fb-34e9-4d88-ae81-da14949aa7c5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7d981fb-34e9-4d88-ae81-da14949aa7c5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7d981fb-34e9-4d88-ae81-da14949aa7c5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7d981fb-34e9-4d88-ae81-da14949aa7c5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:53 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-e7d981fb-34e9-4d88-ae81-da14949aa7c5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6126b468bd2414d831b105a3429ddd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b803e7cf929440298b14cd3177c96e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:53 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e7d981fb-34e9-4d88-ae81-da14949aa7c5 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" status: 200 len: 1671 microversion: 2.1 time: 0.205268 Apr 11 17:06:53 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 86/261] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:06:53 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => generated 1671 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:06:54 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=9 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:54 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=5 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:06:54 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "924a836a-8dba-4bec-aa59-5cc6250874bc"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:54 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] HTTP exception thrown: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Request method failure captured: Apr 11 17:06:54 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee HTTP/1.1 Apr 11 17:06:54 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:06:54 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:06:54 user devstack@n-api.service[61422]: Connection: close Apr 11 17:06:54 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:06:54 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:06:54 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:06:54 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:06:54 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLJCgZZkOHawA-8-TcKBV3EMqf9_JVr6o72QJQTA_VxTdNu4j2N8MWZ4UPj7voZCCI8pmPE68aLr9lKyVsTu_NFwtnFUkSWtLiOPXQSDFOMvxFNjEIz3mrvJFQ7jlj-Lh3tcMJP7dP17QDs5Fsw9zsLOjuhSKGzLTGvxtBSa-fklX8 Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Project-Id: d5ab1632b5534eb9b5096d25137bd538 Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Project-Name: tempest-TaggedBootDevicesTest-762093980 Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5ab1632b5534eb9b5096d25137bd538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5ab1632b5534eb9b5096d25137bd538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5ab1632b5534eb9b5096d25137bd538"}]}] Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Tenant: tempest-TaggedBootDevicesTest-762093980 Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Tenant-Id: d5ab1632b5534eb9b5096d25137bd538 Apr 11 17:06:54 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TaggedBootDevicesTest-762093980 Apr 11 17:06:54 user devstack@n-api.service[61422]: X-User: tempest-TaggedBootDevicesTest-762093980-project-member Apr 11 17:06:54 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:06:54 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:06:54 user devstack@n-api.service[61422]: X-User-Id: 9fda97057cf6440f8a117c8a01cde53a Apr 11 17:06:54 user devstack@n-api.service[61422]: X-User-Name: tempest-TaggedBootDevicesTest-762093980-project-member Apr 11 17:06:54 user devstack@n-api.service[61422]: method: > Apr 11 17:06:54 user devstack@n-api.service[61422]: exception: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:54 user devstack@n-api.service[61422]: action_args: {'id': '4b822b32-bf4e-43e4-9024-32318a7db4ee'} Apr 11 17:06:54 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:54 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Returning 404 to user: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c2aeb888-7a90-43f1-bd46-10a062fb3895 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee" status: 404 len: 111 microversion: 2.32 time: 0.028959 Apr 11 17:06:54 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 88/262] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:06:54 2023] GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:06:54 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f6b69c1c-3ef5-4fe3-9677-31c7973cf7e4 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Calling method '.version_select at 0x7f5bddb243a0>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f6b69c1c-3ef5-4fe3-9677-31c7973cf7e4 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-79124000" status: 204 len: 0 microversion: 2.32 time: 0.028605 Apr 11 17:06:54 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 87/263] 10.0.0.210 () {64 vars in 1333 bytes} [Tue Apr 11 17:06:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-79124000 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e21b153f-bbab-42d2-843b-a71868336a8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e21b153f-bbab-42d2-843b-a71868336a8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e21b153f-bbab-42d2-843b-a71868336a8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e21b153f-bbab-42d2-843b-a71868336a8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e21b153f-bbab-42d2-843b-a71868336a8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e21b153f-bbab-42d2-843b-a71868336a8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e21b153f-bbab-42d2-843b-a71868336a8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e21b153f-bbab-42d2-843b-a71868336a8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:54 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-e70ba219-f03b-4315-8a73-2a0ed85ff427 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "POST /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311287 Apr 11 17:06:54 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 89/264] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:06:54 2023] POST /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e21b153f-bbab-42d2-843b-a71868336a8e tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058922 Apr 11 17:06:54 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:06:54 2023] GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:06:55 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e7245e30-0a0a-499d-9ff9-41aee3fb2a48 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404" status: 204 len: 0 microversion: 2.1 time: 0.150431 Apr 11 17:06:55 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 88/266] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:06:55 2023] DELETE /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c32e2f80-d251-436b-adc6-3aac3851444f tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c32e2f80-d251-436b-adc6-3aac3851444f tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c32e2f80-d251-436b-adc6-3aac3851444f tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c32e2f80-d251-436b-adc6-3aac3851444f tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c32e2f80-d251-436b-adc6-3aac3851444f tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c32e2f80-d251-436b-adc6-3aac3851444f tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c32e2f80-d251-436b-adc6-3aac3851444f tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c32e2f80-d251-436b-adc6-3aac3851444f tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-c32e2f80-d251-436b-adc6-3aac3851444f tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f20dcfb0f94c419b9111571e89bc3aa4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9791f1371ba74005a40cd51a63d63c94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] HTTP exception thrown: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Request method failure captured: Apr 11 17:06:55 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 HTTP/1.1 Apr 11 17:06:55 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:06:55 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:06:55 user devstack@n-api.service[61422]: Connection: close Apr 11 17:06:55 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:06:55 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:06:55 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:06:55 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:06:55 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLB5TA5k2IwH2Fi20fgVi2Y8b7bEiZcb0fxqKvRnkCG612zlPQ0UwhRstZf4evLfkAUWR82bLGP2A_qh29IOpT2_-G1fOwMNUpOBRLytF6p_pWUPAphc6od363VyEVmHB1OY3FJqmvjnTV7G4L-I2k6KwL2Ol0Dkp4VL_DzedQtdyA Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Project-Id: 6c144e1059e44b55bb7aa451b9547a75 Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1893104567 Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6c144e1059e44b55bb7aa451b9547a75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6c144e1059e44b55bb7aa451b9547a75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6c144e1059e44b55bb7aa451b9547a75"}]}] Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1893104567 Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Tenant-Id: 6c144e1059e44b55bb7aa451b9547a75 Apr 11 17:06:55 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1893104567 Apr 11 17:06:55 user devstack@n-api.service[61422]: X-User: tempest-TaggedBootDevicesTest_v242-1893104567-project-member Apr 11 17:06:55 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:06:55 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:06:55 user devstack@n-api.service[61422]: X-User-Id: b2f35f746a2c41828b209a93f555993c Apr 11 17:06:55 user devstack@n-api.service[61422]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1893104567-project-member Apr 11 17:06:55 user devstack@n-api.service[61422]: method: > Apr 11 17:06:55 user devstack@n-api.service[61422]: exception: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:06:55 user devstack@n-api.service[61422]: action_args: {'id': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1'} Apr 11 17:06:55 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:06:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Returning 404 to user: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c32e2f80-d251-436b-adc6-3aac3851444f tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404" status: 200 len: 1649 microversion: 2.1 time: 0.240466 Apr 11 17:06:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-2249c0da-08a1-4b8a-9da6-a6ff00316437 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" status: 404 len: 111 microversion: 2.42 time: 0.033877 Apr 11 17:06:55 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 90/267] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:06:55 2023] GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404 => generated 1649 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:06:55 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 90/268] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:06:55 2023] GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b8d1f1b9-d557-4465-b288-c027d4e72338 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Calling method '.version_select at 0x7f5bddab1240>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:55 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-b8d1f1b9-d557-4465-b288-c027d4e72338 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087464564" status: 204 len: 0 microversion: 2.42 time: 0.025324 Apr 11 17:06:55 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 89/269] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 17:06:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2087464564 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-af8aea41-b717-4f88-a053-e5a36438db3e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-af8aea41-b717-4f88-a053-e5a36438db3e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af8aea41-b717-4f88-a053-e5a36438db3e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af8aea41-b717-4f88-a053-e5a36438db3e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af8aea41-b717-4f88-a053-e5a36438db3e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af8aea41-b717-4f88-a053-e5a36438db3e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af8aea41-b717-4f88-a053-e5a36438db3e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af8aea41-b717-4f88-a053-e5a36438db3e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180c44cc-172d-4e8c-b4ec-6259e775c404", "name": "network-vif-unplugged", "status": "completed", "tag": "3bc601e8-552e-473e-abe3-24e32a78188f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] Creating event network-vif-unplugged:3bc601e8-552e-473e-abe3-24e32a78188f for instance 180c44cc-172d-4e8c-b4ec-6259e775c404 on user Apr 11 17:06:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-615a7c2e-0738-4826-a464-7cc7916653f5 req-2f636a3d-dbd0-4981-a4d8-572d94e09f19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047192 Apr 11 17:06:55 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 91/270] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:55 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-af8aea41-b717-4f88-a053-e5a36438db3e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:06:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-af8aea41-b717-4f88-a053-e5a36438db3e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1658 microversion: 2.1 time: 0.241227 Apr 11 17:06:55 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:06:55 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1658 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24daff67-0055-44fd-8be9-acf4b3f77ff5"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:56 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-faf22c09-e9c4-4bb6-a7da-e1e4e3173bbe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384838 Apr 11 17:06:56 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 90/272] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:06:55 2023] POST /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:57 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180c44cc-172d-4e8c-b4ec-6259e775c404", "name": "network-vif-plugged", "status": "completed", "tag": "3bc601e8-552e-473e-abe3-24e32a78188f"}, {"server_uuid": "180c44cc-172d-4e8c-b4ec-6259e775c404", "name": "network-vif-deleted", "tag": "3bc601e8-552e-473e-abe3-24e32a78188f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:06:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] Creating event network-vif-plugged:3bc601e8-552e-473e-abe3-24e32a78188f for instance 180c44cc-172d-4e8c-b4ec-6259e775c404 on user Apr 11 17:06:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] Creating event network-vif-deleted:3bc601e8-552e-473e-abe3-24e32a78188f for instance 180c44cc-172d-4e8c-b4ec-6259e775c404 on user Apr 11 17:06:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-21db8fb9-3c0b-4ab2-adf0-1759529181c1 req-a525585a-7825-40b0-a8f0-0c9e57bdbe64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038273 Apr 11 17:06:57 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 92/273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:06:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:06:58 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:58 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:58 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] HTTP exception thrown: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:58 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Request method failure captured: Apr 11 17:06:58 user devstack@n-api.service[61424]: request: DELETE /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee HTTP/1.1 Apr 11 17:06:58 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:06:58 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:06:58 user devstack@n-api.service[61424]: Connection: close Apr 11 17:06:58 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:06:58 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:06:58 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:06:58 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:06:58 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZLJCgZZkOHawA-8-TcKBV3EMqf9_JVr6o72QJQTA_VxTdNu4j2N8MWZ4UPj7voZCCI8pmPE68aLr9lKyVsTu_NFwtnFUkSWtLiOPXQSDFOMvxFNjEIz3mrvJFQ7jlj-Lh3tcMJP7dP17QDs5Fsw9zsLOjuhSKGzLTGvxtBSa-fklX8 Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Project-Id: d5ab1632b5534eb9b5096d25137bd538 Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Project-Name: tempest-TaggedBootDevicesTest-762093980 Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5ab1632b5534eb9b5096d25137bd538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5ab1632b5534eb9b5096d25137bd538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5ab1632b5534eb9b5096d25137bd538"}]}] Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Tenant: tempest-TaggedBootDevicesTest-762093980 Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Tenant-Id: d5ab1632b5534eb9b5096d25137bd538 Apr 11 17:06:58 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-TaggedBootDevicesTest-762093980 Apr 11 17:06:58 user devstack@n-api.service[61424]: X-User: tempest-TaggedBootDevicesTest-762093980-project-member Apr 11 17:06:58 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:06:58 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:06:58 user devstack@n-api.service[61424]: X-User-Id: 9fda97057cf6440f8a117c8a01cde53a Apr 11 17:06:58 user devstack@n-api.service[61424]: X-User-Name: tempest-TaggedBootDevicesTest-762093980-project-member Apr 11 17:06:58 user devstack@n-api.service[61424]: method: > Apr 11 17:06:58 user devstack@n-api.service[61424]: exception: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:58 user devstack@n-api.service[61424]: action_args: {'id': '4b822b32-bf4e-43e4-9024-32318a7db4ee'} Apr 11 17:06:58 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:58 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:06:58 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Returning 404 to user: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:58 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-2fb0ac21-8dfa-4643-b619-77ea09459a7a tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee" status: 404 len: 111 microversion: 2.32 time: 0.040678 Apr 11 17:06:58 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 92/274] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:06:58 2023] DELETE /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:06:58 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:06:58 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] [instance: 4b822b32-bf4e-43e4-9024-32318a7db4ee] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:06:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:06:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:06:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:06:58 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] HTTP exception thrown: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:58 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Request method failure captured: Apr 11 17:06:58 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee HTTP/1.1 Apr 11 17:06:58 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:06:58 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:06:58 user devstack@n-api.service[61423]: Connection: close Apr 11 17:06:58 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:06:58 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:06:58 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:06:58 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:06:58 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLJCgZZkOHawA-8-TcKBV3EMqf9_JVr6o72QJQTA_VxTdNu4j2N8MWZ4UPj7voZCCI8pmPE68aLr9lKyVsTu_NFwtnFUkSWtLiOPXQSDFOMvxFNjEIz3mrvJFQ7jlj-Lh3tcMJP7dP17QDs5Fsw9zsLOjuhSKGzLTGvxtBSa-fklX8 Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Project-Id: d5ab1632b5534eb9b5096d25137bd538 Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Project-Name: tempest-TaggedBootDevicesTest-762093980 Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5ab1632b5534eb9b5096d25137bd538"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5ab1632b5534eb9b5096d25137bd538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5ab1632b5534eb9b5096d25137bd538"}]}] Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Tenant: tempest-TaggedBootDevicesTest-762093980 Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Tenant-Id: d5ab1632b5534eb9b5096d25137bd538 Apr 11 17:06:58 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-TaggedBootDevicesTest-762093980 Apr 11 17:06:58 user devstack@n-api.service[61423]: X-User: tempest-TaggedBootDevicesTest-762093980-project-member Apr 11 17:06:58 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:06:58 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:06:58 user devstack@n-api.service[61423]: X-User-Id: 9fda97057cf6440f8a117c8a01cde53a Apr 11 17:06:58 user devstack@n-api.service[61423]: X-User-Name: tempest-TaggedBootDevicesTest-762093980-project-member Apr 11 17:06:58 user devstack@n-api.service[61423]: method: > Apr 11 17:06:58 user devstack@n-api.service[61423]: exception: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:58 user devstack@n-api.service[61423]: action_args: {'id': '4b822b32-bf4e-43e4-9024-32318a7db4ee'} Apr 11 17:06:58 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. Apr 11 17:06:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:06:58 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] Returning 404 to user: Instance 4b822b32-bf4e-43e4-9024-32318a7db4ee could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:06:58 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-cb1b4b15-a9e6-4b6f-a41c-7adcdfa3f222 tempest-TaggedBootDevicesTest-762093980 tempest-TaggedBootDevicesTest-762093980-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee" status: 404 len: 111 microversion: 2.32 time: 0.055506 Apr 11 17:06:58 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 91/275] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:06:58 2023] GET /compute/v2.1/servers/4b822b32-bf4e-43e4-9024-32318a7db4ee => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:07:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:01 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] HTTP exception thrown: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:07:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Request method failure captured: Apr 11 17:07:01 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 HTTP/1.1 Apr 11 17:07:01 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:07:01 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:07:01 user devstack@n-api.service[61422]: Connection: close Apr 11 17:07:01 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:07:01 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:07:01 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:07:01 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:07:01 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLB5TA5k2IwH2Fi20fgVi2Y8b7bEiZcb0fxqKvRnkCG612zlPQ0UwhRstZf4evLfkAUWR82bLGP2A_qh29IOpT2_-G1fOwMNUpOBRLytF6p_pWUPAphc6od363VyEVmHB1OY3FJqmvjnTV7G4L-I2k6KwL2Ol0Dkp4VL_DzedQtdyA Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Project-Id: 6c144e1059e44b55bb7aa451b9547a75 Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1893104567 Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6c144e1059e44b55bb7aa451b9547a75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6c144e1059e44b55bb7aa451b9547a75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6c144e1059e44b55bb7aa451b9547a75"}]}] Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1893104567 Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Tenant-Id: 6c144e1059e44b55bb7aa451b9547a75 Apr 11 17:07:01 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1893104567 Apr 11 17:07:01 user devstack@n-api.service[61422]: X-User: tempest-TaggedBootDevicesTest_v242-1893104567-project-member Apr 11 17:07:01 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:07:01 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:07:01 user devstack@n-api.service[61422]: X-User-Id: b2f35f746a2c41828b209a93f555993c Apr 11 17:07:01 user devstack@n-api.service[61422]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1893104567-project-member Apr 11 17:07:01 user devstack@n-api.service[61422]: method: > Apr 11 17:07:01 user devstack@n-api.service[61422]: exception: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:07:01 user devstack@n-api.service[61422]: action_args: {'id': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1'} Apr 11 17:07:01 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:07:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:07:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Returning 404 to user: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:07:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-bcab0357-f4cd-4930-8995-8448a6ab0584 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" status: 404 len: 111 microversion: 2.42 time: 0.037303 Apr 11 17:07:01 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 93/276] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:07:01 2023] DELETE /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:07:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:01 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] [instance: fc8f8805-6d61-45a5-b56f-d2c0b107e9c1] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] HTTP exception thrown: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:07:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Request method failure captured: Apr 11 17:07:01 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 HTTP/1.1 Apr 11 17:07:01 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:07:01 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:07:01 user devstack@n-api.service[61424]: Connection: close Apr 11 17:07:01 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:07:01 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:07:01 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:07:01 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:07:01 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZLB5TA5k2IwH2Fi20fgVi2Y8b7bEiZcb0fxqKvRnkCG612zlPQ0UwhRstZf4evLfkAUWR82bLGP2A_qh29IOpT2_-G1fOwMNUpOBRLytF6p_pWUPAphc6od363VyEVmHB1OY3FJqmvjnTV7G4L-I2k6KwL2Ol0Dkp4VL_DzedQtdyA Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Project-Id: 6c144e1059e44b55bb7aa451b9547a75 Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1893104567 Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6c144e1059e44b55bb7aa451b9547a75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6c144e1059e44b55bb7aa451b9547a75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6c144e1059e44b55bb7aa451b9547a75"}]}] Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1893104567 Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Tenant-Id: 6c144e1059e44b55bb7aa451b9547a75 Apr 11 17:07:01 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1893104567 Apr 11 17:07:01 user devstack@n-api.service[61424]: X-User: tempest-TaggedBootDevicesTest_v242-1893104567-project-member Apr 11 17:07:01 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:07:01 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:07:01 user devstack@n-api.service[61424]: X-User-Id: b2f35f746a2c41828b209a93f555993c Apr 11 17:07:01 user devstack@n-api.service[61424]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1893104567-project-member Apr 11 17:07:01 user devstack@n-api.service[61424]: method: > Apr 11 17:07:01 user devstack@n-api.service[61424]: exception: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:07:01 user devstack@n-api.service[61424]: action_args: {'id': 'fc8f8805-6d61-45a5-b56f-d2c0b107e9c1'} Apr 11 17:07:01 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. Apr 11 17:07:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:07:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] Returning 404 to user: Instance fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:07:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-d1b24d03-d7e7-4660-9a81-a5e5b0124103 tempest-TaggedBootDevicesTest_v242-1893104567 tempest-TaggedBootDevicesTest_v242-1893104567-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1" status: 404 len: 111 microversion: 2.42 time: 0.118245 Apr 11 17:07:01 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 93/277] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:07:01 2023] GET /compute/v2.1/servers/fc8f8805-6d61-45a5-b56f-d2c0b107e9c1 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:07:01 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:01 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:02 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:02 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:02 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:02 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ebfeee4f-0bd9-4336-953c-3844be97de91 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02" status: 200 len: 1769 microversion: 2.87 time: 0.255892 Apr 11 17:07:02 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 92/278] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:07:01 2023] GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02 => generated 1769 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:07:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "092f4818-05d2-4f43-becf-b000e59860ae"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:02 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:02 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'flavor' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:07:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-82200f9b-bfc1-4b0f-b70c-45f66b32862e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "POST /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/action" status: 200 len: 29 microversion: 2.1 time: 0.225365 Apr 11 17:07:02 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 94/279] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:07:02 2023] POST /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/action => generated 29 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:07:02 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-bc209fbd-7fb3-4f70-8a63-e81d57b53711 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:02 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-bc209fbd-7fb3-4f70-8a63-e81d57b53711 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc209fbd-7fb3-4f70-8a63-e81d57b53711 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc209fbd-7fb3-4f70-8a63-e81d57b53711 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc209fbd-7fb3-4f70-8a63-e81d57b53711 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc209fbd-7fb3-4f70-8a63-e81d57b53711 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc209fbd-7fb3-4f70-8a63-e81d57b53711 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc209fbd-7fb3-4f70-8a63-e81d57b53711 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:03 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-bc209fbd-7fb3-4f70-8a63-e81d57b53711 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6126b468bd2414d831b105a3429ddd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b803e7cf929440298b14cd3177c96e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:03 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-bc209fbd-7fb3-4f70-8a63-e81d57b53711 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" status: 200 len: 1723 microversion: 2.1 time: 0.222377 Apr 11 17:07:03 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 94/280] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:02 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:07:03 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-78024d60-eb5a-444f-9625-84e5743062d4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:03 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-78024d60-eb5a-444f-9625-84e5743062d4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78024d60-eb5a-444f-9625-84e5743062d4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78024d60-eb5a-444f-9625-84e5743062d4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78024d60-eb5a-444f-9625-84e5743062d4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78024d60-eb5a-444f-9625-84e5743062d4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78024d60-eb5a-444f-9625-84e5743062d4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78024d60-eb5a-444f-9625-84e5743062d4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:04 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-78024d60-eb5a-444f-9625-84e5743062d4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-78024d60-eb5a-444f-9625-84e5743062d4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1704 microversion: 2.1 time: 0.199299 Apr 11 17:07:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 93/281] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:03 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1704 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-745930106", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for project db242f5f39d94966948e8b487cd52d0c. Resources: dict_keys(['metadata_items']) {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for user 8f4ba7d7f3f74b5c800be2408c1035e2 and project db242f5f39d94966948e8b487cd52d0c. Resources: dict_keys(['metadata_items']) {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:07:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-unplugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] Creating event network-vif-unplugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:07:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-4a4eaaeb-55ce-4233-b2fc-630a65208226 req-2cd26f3a-c36d-436d-9ea9-a55fce9e9658 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042702 Apr 11 17:07:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 95/282] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-67d3591a-9931-43d9-bdf8-4f4f6e96a2df tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/action" status: 202 len: 1158 microversion: 2.1 time: 0.479924 Apr 11 17:07:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 95/283] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Apr 11 17:07:04 2023] POST /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/action => generated 1158 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 17:07:04 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-dac420fc-4c06-4f08-a7c9-cfb982352076 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-dac420fc-4c06-4f08-a7c9-cfb982352076 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dac420fc-4c06-4f08-a7c9-cfb982352076 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dac420fc-4c06-4f08-a7c9-cfb982352076 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dac420fc-4c06-4f08-a7c9-cfb982352076 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dac420fc-4c06-4f08-a7c9-cfb982352076 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dac420fc-4c06-4f08-a7c9-cfb982352076 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dac420fc-4c06-4f08-a7c9-cfb982352076 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:05 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-dac420fc-4c06-4f08-a7c9-cfb982352076 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:05 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-dac420fc-4c06-4f08-a7c9-cfb982352076 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1731 microversion: 2.1 time: 0.825672 Apr 11 17:07:05 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 94/284] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:04 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1731 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:07:06 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-plugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}, {"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-unplugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}, {"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:06 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:06 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:06 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Creating event network-vif-plugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:07:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Creating event network-vif-unplugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:07:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:07:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-fbb8d131-8858-4ee8-a829-de4fd205d32d req-fa59dd54-70ee-47f2-9799-7e71780dbe0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.058773 Apr 11 17:07:06 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 96/285] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:06 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3606b301-8099-4fb9-9c43-1a35ff3edaf8 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:07 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-3606b301-8099-4fb9-9c43-1a35ff3edaf8 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3606b301-8099-4fb9-9c43-1a35ff3edaf8 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3606b301-8099-4fb9-9c43-1a35ff3edaf8 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3606b301-8099-4fb9-9c43-1a35ff3edaf8 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3606b301-8099-4fb9-9c43-1a35ff3edaf8 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3606b301-8099-4fb9-9c43-1a35ff3edaf8 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3606b301-8099-4fb9-9c43-1a35ff3edaf8 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3606b301-8099-4fb9-9c43-1a35ff3edaf8 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051073 Apr 11 17:07:07 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 96/286] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:07:07 2023] GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:07:08 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-914262045"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:08 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:09 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-plugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:09 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] Creating event network-vif-plugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:07:09 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-2431fb6f-5d2a-4a7a-b889-5e41756768f0 req-d3623bdc-516a-448a-8973-247555bc71cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051173 Apr 11 17:07:09 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 97/287] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:09 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-73458da6-a840-42ac-8a14-e53f9b651148 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/action" status: 202 len: 0 microversion: 2.1 time: 1.310018 Apr 11 17:07:09 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 95/288] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:07:08 2023] POST /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/action => generated 0 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 17:07:11 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:11 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Going to try to start instance {{(pid=61422) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 17:07:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7c985073-b429-48b9-a90c-8a52d33055bc tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/action" status: 202 len: 0 microversion: 2.1 time: 0.110877 Apr 11 17:07:11 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 97/289] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:07:11 2023] POST /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:07:11 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-fd327796-d958-4381-a63e-fa79ac5b9bce tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:11 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-fd327796-d958-4381-a63e-fa79ac5b9bce tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd327796-d958-4381-a63e-fa79ac5b9bce tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd327796-d958-4381-a63e-fa79ac5b9bce tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd327796-d958-4381-a63e-fa79ac5b9bce tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd327796-d958-4381-a63e-fa79ac5b9bce tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd327796-d958-4381-a63e-fa79ac5b9bce tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd327796-d958-4381-a63e-fa79ac5b9bce tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:11 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-plugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] Creating event network-vif-plugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:07:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-73d77664-924b-48df-b0bb-49e1c2d09bda req-04f81fe0-cfa6-42a3-b51c-1ff5e61b1eaf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037532 Apr 11 17:07:11 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 96/290] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:11 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-fd327796-d958-4381-a63e-fa79ac5b9bce tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-fd327796-d958-4381-a63e-fa79ac5b9bce tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 200 len: 1699 microversion: 2.1 time: 0.362339 Apr 11 17:07:11 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 98/291] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:11 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 1699 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:07:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4b1461b8-a8d5-404a-9e87-54d279def9b0 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:13 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-4b1461b8-a8d5-404a-9e87-54d279def9b0 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4b1461b8-a8d5-404a-9e87-54d279def9b0 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4b1461b8-a8d5-404a-9e87-54d279def9b0 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4b1461b8-a8d5-404a-9e87-54d279def9b0 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4b1461b8-a8d5-404a-9e87-54d279def9b0 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4b1461b8-a8d5-404a-9e87-54d279def9b0 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4b1461b8-a8d5-404a-9e87-54d279def9b0 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:14 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-4b1461b8-a8d5-404a-9e87-54d279def9b0 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd111d892e2944f279a36622978b2dd06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381738c7ad99437b875807c4252965bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:14 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-4b1461b8-a8d5-404a-9e87-54d279def9b0 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" status: 200 len: 1495 microversion: 2.1 time: 0.665043 Apr 11 17:07:14 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 98/292] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:13 2023] GET /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b => generated 1495 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1895242332", "imageRef": "17bbf027-fa96-46ed-80c2-65e5f74cbbd2", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1509466846", "security_groups": [{"name": "tempest-secgroup-smoke-1624742076"}], "networks": [{"uuid": "bdb09d43-70cb-4856-948c-4e13c107fac8"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] validate_networks() for [('bdb09d43-70cb-4856-948c-4e13c107fac8', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:19 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Getting quotas for project ec4085a617084465ae810ff06498f992. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:07:19 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Getting quotas for user 1f7d3b94cc6b4a7d95489d7d4cf6e297 and project ec4085a617084465ae810ff06498f992. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:07:19 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:07:19 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17bbf027-fa96-46ed-80c2-65e5f74cbbd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:07:19 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-759c3cab-1ad2-4ed9-90da-d782f08b0013 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.892503 Apr 11 17:07:19 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 97/293] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:07:18 2023] POST /compute/v2.1/servers => generated 404 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:07:19 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-12be98cb-9353-42c9-a973-106dd5db59da tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:19 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-12be98cb-9353-42c9-a973-106dd5db59da tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:19 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:19 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=4,nova_cell1:DELETE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:07:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-ff92697f-1aef-47f0-bcc5-260c6caca253 req-11c1042e-37fc-460d-a4b8-730c7c279259 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039928 Apr 11 17:07:19 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 99/294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:19 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-12be98cb-9353-42c9-a973-106dd5db59da tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f7d3b94cc6b4a7d95489d7d4cf6e297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4085a617084465ae810ff06498f992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:19 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-12be98cb-9353-42c9-a973-106dd5db59da tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995" status: 200 len: 1237 microversion: 2.1 time: 0.098995 Apr 11 17:07:19 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 99/295] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:19 2023] GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995 => generated 1237 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:07:20 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:07:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-475ae7b3-55c8-42cc-9d43-596c96a75faa req-6e763756-8823-4f02-8415-9f264084c1ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054699 Apr 11 17:07:20 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 98/296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:21 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=39 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:07:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5f96bbd6-56db-4d06-a822-c3ef33fc9625 req-0575d828-8d1e-4b6b-93d6-0443c2a98338 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053186 Apr 11 17:07:21 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 100/297] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:22 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:22 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:07:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-347ca1f2-df43-4bfe-a89c-076da4214594 req-a752f6d6-fae0-4ddc-be70-b2869717105d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089998 Apr 11 17:07:22 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 100/298] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:26 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b7642b-356d-4122-b006-fe7681192995", "tag": "24930491-6f3c-445d-ad6b-c4d37775783a"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:26 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:26 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:26 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] Creating event network-changed:24930491-6f3c-445d-ad6b-c4d37775783a for instance 43b7642b-356d-4122-b006-fe7681192995 on user Apr 11 17:07:26 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-da1c7600-f475-4308-92b2-80b2d5ce3470 req-72bc60d6-6e7a-4bfb-b8e9-83618afa20dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067079 Apr 11 17:07:26 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 99/299] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:29 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:29 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b7642b-356d-4122-b006-fe7681192995", "name": "network-vif-plugged", "status": "completed", "tag": "24930491-6f3c-445d-ad6b-c4d37775783a"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:29 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=27 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:29 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] Creating event network-vif-plugged:24930491-6f3c-445d-ad6b-c4d37775783a for instance 43b7642b-356d-4122-b006-fe7681192995 on user Apr 11 17:07:29 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-95efb1a5-9db9-42a3-8722-c9d07d53cbc4 req-6605f168-fb30-42f5-8643-f825372a2754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098310 Apr 11 17:07:29 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 101/300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b01e20e7-10da-44de-bb7f-5b15863afa50 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd967f40>, body: {"keypair": {"name": "tempest-TestShelveInstance-1839642534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAD1iD/M9MyvgtRPwRjRcQanIre2nNXOXBvUg4AGkq7sAV6+m5pBZBbB9GJsn7+K0l8XV22PLOcPZAVhc0KhDPSgFmZjERVUBTk3/Eey+mjvEgyssoBy0YWVpHwpdZYxig=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:29 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-b01e20e7-10da-44de-bb7f-5b15863afa50 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Getting quotas for project bf2f734d27a049e7b97ba50db0db0b6c. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:07:29 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-b01e20e7-10da-44de-bb7f-5b15863afa50 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Getting quotas for user ea404079db924f70b4a22278cee452dc and project bf2f734d27a049e7b97ba50db0db0b6c. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:07:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b01e20e7-10da-44de-bb7f-5b15863afa50 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.344163 Apr 11 17:07:29 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 101/301] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:07:29 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:31 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:31 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:31 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-626401967", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:31 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] validate_networks() for [('cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:07:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b7642b-356d-4122-b006-fe7681192995", "name": "network-vif-plugged", "status": "completed", "tag": "24930491-6f3c-445d-ad6b-c4d37775783a"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] Creating event network-vif-plugged:24930491-6f3c-445d-ad6b-c4d37775783a for instance 43b7642b-356d-4122-b006-fe7681192995 on user Apr 11 17:07:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-c71d30b0-a7ab-4ab5-82fa-e31125c6da86 req-cb6ac72c-ebeb-46ee-b9fd-4e829b3d9408 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040293 Apr 11 17:07:31 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 102/302] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Getting quotas for project 3ab7d4c5adc544ef9ed9f774e1e144cc. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Getting quotas for user 2878fecd141a4c0f97ead618b9cfdcbf and project 3ab7d4c5adc544ef9ed9f774e1e144cc. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:07:32 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:07:32 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-a847d670-e7a6-44e8-b81b-d6fd324a70aa tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.376666 Apr 11 17:07:32 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 100/303] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:07:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:07:32 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:32 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-18442b00-2ee0-4e43-8ea1-2ee3b5d8b9ae tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:32 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-18442b00-2ee0-4e43-8ea1-2ee3b5d8b9ae tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:32 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-18442b00-2ee0-4e43-8ea1-2ee3b5d8b9ae tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878fecd141a4c0f97ead618b9cfdcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab7d4c5adc544ef9ed9f774e1e144cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:32 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-18442b00-2ee0-4e43-8ea1-2ee3b5d8b9ae tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6" status: 200 len: 1212 microversion: 2.1 time: 0.119177 Apr 11 17:07:32 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 102/304] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:32 2023] GET /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6 => generated 1212 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:07:32 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-567354548", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "fc5f2351-9e4e-4481-9745-87fe310d86e2"}]}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:32 user devstack@n-api.service[61424]: DEBUG nova.network.neutron [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] validate_networks() for [('fc5f2351-9e4e-4481-9745-87fe310d86e2', None, None, None, None, None)] {{(pid=61424) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Flavor limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Image limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Flavor pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Image pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Getting quotas for project d1c61fd594564317a51c9dadebbba6c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Getting quotas for user d0c53186c18940aba415e0b999cbc2a0 and project d1c61fd594564317a51c9dadebbba6c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Going to run 1 instances... {{(pid=61424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:07:33 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:07:33 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f044b7af-a6a8-4732-8a8d-c879b60b0f76 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.765331 Apr 11 17:07:33 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 103/305] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:07:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:07:33 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f8d8b808-d2be-4720-817a-27439e74cc1c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:33 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-f8d8b808-d2be-4720-817a-27439e74cc1c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:33 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-f8d8b808-d2be-4720-817a-27439e74cc1c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:33 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f8d8b808-d2be-4720-817a-27439e74cc1c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705" status: 200 len: 1210 microversion: 2.1 time: 0.070510 Apr 11 17:07:33 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 101/306] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:33 2023] GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705 => generated 1210 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:07:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-263726245", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1839642534", "security_groups": [{"name": "tempest-secgroup-smoke-1727356625"}], "networks": [{"uuid": "725f2a46-c18b-4884-8982-1dd55f06826d"}], "block_device_mapping_v2": [{"uuid": "fbbb37a6-c422-4ef3-98c9-e208a1934805", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] validate_networks() for [('725f2a46-c18b-4884-8982-1dd55f06826d', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Getting quotas for project bf2f734d27a049e7b97ba50db0db0b6c. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Getting quotas for user ea404079db924f70b4a22278cee452dc and project bf2f734d27a049e7b97ba50db0db0b6c. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:07:34 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbbb37a6-c422-4ef3-98c9-e208a1934805',volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:07:35 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-94b49b55-bed6-4f7e-a6ae-7731073022a0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.385892 Apr 11 17:07:35 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 103/307] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:07:33 2023] POST /compute/v2.1/servers => generated 404 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:07:35 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-8828d26c-2936-468f-947e-d80d5975f042 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:35 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-8828d26c-2936-468f-947e-d80d5975f042 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:35 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-8828d26c-2936-468f-947e-d80d5975f042 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea404079db924f70b4a22278cee452dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2f734d27a049e7b97ba50db0db0b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-8828d26c-2936-468f-947e-d80d5975f042 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca" status: 200 len: 1083 microversion: 2.1 time: 0.102195 Apr 11 17:07:35 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 104/308] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:35 2023] GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca => generated 1083 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:07:36 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfbf4deb-df22-4546-b215-61afb77efcc6", "tag": "65b16011-5edc-4a36-9493-4ad587afbc19"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:36 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] Creating event network-changed:65b16011-5edc-4a36-9493-4ad587afbc19 for instance cfbf4deb-df22-4546-b215-61afb77efcc6 on user Apr 11 17:07:36 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-d47bed0b-be07-4677-9f1b-901903065a81 req-c9898ed6-9645-4b95-beab-25de079ab738 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053515 Apr 11 17:07:36 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 102/309] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:36 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5bb4495-9a2d-4903-8158-c57b78e43705", "tag": "15355548-ee2d-4cc0-abd1-44a292fa87dc"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] Creating event network-changed:15355548-ee2d-4cc0-abd1-44a292fa87dc for instance c5bb4495-9a2d-4903-8158-c57b78e43705 on user Apr 11 17:07:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5ddb830c-c51d-4939-8c80-2b37439af5eb req-cd627b93-3d6e-44ba-ab64-cd137b5a511f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049185 Apr 11 17:07:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 104/310] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:39 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] Creating event network-changed:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:07:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-c91cdc81-8115-40c1-9f70-20661a9ed1ae req-ea78edf1-316d-40ea-8340-af83c8864915 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040163 Apr 11 17:07:39 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 105/311] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:40 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf4deb-df22-4546-b215-61afb77efcc6", "name": "network-vif-plugged", "status": "completed", "tag": "65b16011-5edc-4a36-9493-4ad587afbc19"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:40 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] Creating event network-vif-plugged:65b16011-5edc-4a36-9493-4ad587afbc19 for instance cfbf4deb-df22-4546-b215-61afb77efcc6 on user Apr 11 17:07:40 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-6e6484c6-1d06-41b6-a8b0-205d1644bdee req-6a9ca873-524e-4d5c-89c0-c5fde21e078b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059859 Apr 11 17:07:40 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 103/312] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5bb4495-9a2d-4903-8158-c57b78e43705", "name": "network-vif-plugged", "status": "completed", "tag": "15355548-ee2d-4cc0-abd1-44a292fa87dc"}, {"server_uuid": "c5bb4495-9a2d-4903-8158-c57b78e43705", "name": "network-vif-plugged", "status": "completed", "tag": "15355548-ee2d-4cc0-abd1-44a292fa87dc"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Creating event network-vif-plugged:15355548-ee2d-4cc0-abd1-44a292fa87dc for instance c5bb4495-9a2d-4903-8158-c57b78e43705 on user Apr 11 17:07:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] Creating event network-vif-plugged:15355548-ee2d-4cc0-abd1-44a292fa87dc for instance c5bb4495-9a2d-4903-8158-c57b78e43705 on user Apr 11 17:07:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-7bbccfcc-dbf4-4310-bc7d-106e87966b7a req-b9ecdf79-a030-4fa4-bc26-edca1ad25160 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038104 Apr 11 17:07:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 105/313] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:42 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf4deb-df22-4546-b215-61afb77efcc6", "name": "network-vif-plugged", "status": "completed", "tag": "65b16011-5edc-4a36-9493-4ad587afbc19"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] Creating event network-vif-plugged:65b16011-5edc-4a36-9493-4ad587afbc19 for instance cfbf4deb-df22-4546-b215-61afb77efcc6 on user Apr 11 17:07:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-2f3c2b69-3cb4-4714-9c12-f2486f7ee297 req-6e5116f0-4401-4116-960f-449e69a7f57c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040161 Apr 11 17:07:42 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 106/314] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] [instance: 180c44cc-172d-4e8c-b4ec-6259e775c404] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:45 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] HTTP exception thrown: Instance 180c44cc-172d-4e8c-b4ec-6259e775c404 could not be found. Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Request method failure captured: Apr 11 17:07:45 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404 HTTP/1.1 Apr 11 17:07:45 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:07:45 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:07:45 user devstack@n-api.service[61423]: Connection: close Apr 11 17:07:45 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:07:45 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:07:45 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:07:45 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:07:45 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLLW6M8JU7aET0fYO833QvlbNgMWuF19W3jlp53Stg0dcQxeyI3HuIcBJkFAaaEDXqMM8jvODMPFlVyVE6l3eGyyDP4YyNLfnnv3KSDPKMXX-MV4gVOLDmCfvyy68Swpy6tty86wSRv5FFKUjx8QAwJLMttP-qMQ860Y2ImHgeUf7s Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Project-Id: 9791f1371ba74005a40cd51a63d63c94 Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Project-Name: tempest-TestVolumeSwap-1972836137 Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9791f1371ba74005a40cd51a63d63c94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9791f1371ba74005a40cd51a63d63c94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9791f1371ba74005a40cd51a63d63c94"}]}] Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Tenant: tempest-TestVolumeSwap-1972836137 Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Tenant-Id: 9791f1371ba74005a40cd51a63d63c94 Apr 11 17:07:45 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-TestVolumeSwap-1972836137 Apr 11 17:07:45 user devstack@n-api.service[61423]: X-User: tempest-TestVolumeSwap-1972836137-project-member Apr 11 17:07:45 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:07:45 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:07:45 user devstack@n-api.service[61423]: X-User-Id: f20dcfb0f94c419b9111571e89bc3aa4 Apr 11 17:07:45 user devstack@n-api.service[61423]: X-User-Name: tempest-TestVolumeSwap-1972836137-project-member Apr 11 17:07:45 user devstack@n-api.service[61423]: method: > Apr 11 17:07:45 user devstack@n-api.service[61423]: exception: Instance 180c44cc-172d-4e8c-b4ec-6259e775c404 could not be found. Apr 11 17:07:45 user devstack@n-api.service[61423]: action_args: {'id': '180c44cc-172d-4e8c-b4ec-6259e775c404'} Apr 11 17:07:45 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180c44cc-172d-4e8c-b4ec-6259e775c404 could not be found. Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180c44cc-172d-4e8c-b4ec-6259e775c404 could not be found. Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180c44cc-172d-4e8c-b4ec-6259e775c404 could not be found. Apr 11 17:07:45 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:07:45 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Returning 404 to user: Instance 180c44cc-172d-4e8c-b4ec-6259e775c404 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:07:45 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-0179a538-f695-47d5-892d-8a249f9097f6 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404" status: 404 len: 111 microversion: 2.1 time: 0.054121 Apr 11 17:07:45 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 104/315] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:45 2023] GET /compute/v2.1/servers/180c44cc-172d-4e8c-b4ec-6259e775c404 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:07:45 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:45 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=12 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:45 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e8c69ae5-b19c-4536-bcef-34177dcd82a1 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] Calling method '.version_select at 0x7f5bdd804280>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:45 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e8c69ae5-b19c-4536-bcef-34177dcd82a1 tempest-TestVolumeSwap-1972836137 tempest-TestVolumeSwap-1972836137-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-527051490" status: 202 len: 0 microversion: 2.1 time: 0.032328 Apr 11 17:07:45 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 106/316] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 17:07:45 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-527051490 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:07:46 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:46 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=8 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:46 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "name": "network-vif-plugged", "status": "completed", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:46 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] Creating event network-vif-plugged:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:07:46 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-3e234023-21dc-441a-abb4-31c06a531453 req-c66c23e9-73ca-4dec-bc79-badf889ef6d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083517 Apr 11 17:07:46 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 107/317] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:48 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "name": "network-vif-plugged", "status": "completed", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] Creating event network-vif-plugged:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:07:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-8c550994-3394-4e34-872c-badc0971d134 req-8ec80d6d-0410-4f1a-8e77-d7b88350c09a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030339 Apr 11 17:07:48 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 105/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:52 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:52 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:52 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:52 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:52 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'flavor' on Instance uuid 25935a69-292b-4d55-932c-f4893838998c {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:07:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8ee2bb69-1d12-4012-acb3-0bdf7b9efd52 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c/action" status: 200 len: 32 microversion: 2.1 time: 0.140145 Apr 11 17:07:52 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 107/319] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:07:52 2023] POST /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c/action => generated 32 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:07:52 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f2e1fd1f-afc4-48e4-92a0-90e81ce04ad7 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:52 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f2e1fd1f-afc4-48e4-92a0-90e81ce04ad7 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f2e1fd1f-afc4-48e4-92a0-90e81ce04ad7 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f2e1fd1f-afc4-48e4-92a0-90e81ce04ad7 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f2e1fd1f-afc4-48e4-92a0-90e81ce04ad7 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f2e1fd1f-afc4-48e4-92a0-90e81ce04ad7 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f2e1fd1f-afc4-48e4-92a0-90e81ce04ad7 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f2e1fd1f-afc4-48e4-92a0-90e81ce04ad7 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:52 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-f2e1fd1f-afc4-48e4-92a0-90e81ce04ad7 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:52 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f2e1fd1f-afc4-48e4-92a0-90e81ce04ad7 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c" status: 200 len: 1510 microversion: 2.1 time: 0.297252 Apr 11 17:07:52 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 108/320] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:52 2023] GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c => generated 1510 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:07:53 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-7218e152-56ef-4923-9690-e6c79855a617 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:53 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-7218e152-56ef-4923-9690-e6c79855a617 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7218e152-56ef-4923-9690-e6c79855a617 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7218e152-56ef-4923-9690-e6c79855a617 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7218e152-56ef-4923-9690-e6c79855a617 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7218e152-56ef-4923-9690-e6c79855a617 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7218e152-56ef-4923-9690-e6c79855a617 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7218e152-56ef-4923-9690-e6c79855a617 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:53 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-unplugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:53 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] Creating event network-vif-unplugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:07:53 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5a9eb769-52fa-4353-b4ef-88a5459915a3 req-ae517cdc-e382-4ea1-ada8-cbe96ae08a73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057585 Apr 11 17:07:53 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 108/321] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:53 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-7218e152-56ef-4923-9690-e6c79855a617 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6126b468bd2414d831b105a3429ddd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b803e7cf929440298b14cd3177c96e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:53 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-7218e152-56ef-4923-9690-e6c79855a617 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" status: 200 len: 1703 microversion: 2.1 time: 0.255317 Apr 11 17:07:53 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 106/322] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:53 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => generated 1703 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 17:07:55 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-plugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] Creating event network-vif-plugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:07:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-27682ac2-be1c-4c58-99de-257c6dcf5d29 req-c82af15d-6e3c-49a2-a194-0c2f65bbeef9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044307 Apr 11 17:07:55 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 109/323] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:07:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-15375f01-eb04-4fbb-8b93-0b6787b32d6d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:07:55 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-15375f01-eb04-4fbb-8b93-0b6787b32d6d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:07:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-15375f01-eb04-4fbb-8b93-0b6787b32d6d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-15375f01-eb04-4fbb-8b93-0b6787b32d6d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-15375f01-eb04-4fbb-8b93-0b6787b32d6d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-15375f01-eb04-4fbb-8b93-0b6787b32d6d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-15375f01-eb04-4fbb-8b93-0b6787b32d6d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-15375f01-eb04-4fbb-8b93-0b6787b32d6d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:55 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-15375f01-eb04-4fbb-8b93-0b6787b32d6d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:07:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-15375f01-eb04-4fbb-8b93-0b6787b32d6d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1722 microversion: 2.1 time: 0.245701 Apr 11 17:07:55 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 109/324] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:07:55 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:07:57 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-plugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}, {"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-plugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:07:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:07:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:07:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:07:57 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=18 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:07:57 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Creating event network-vif-plugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:07:57 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] Creating event network-vif-plugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:07:57 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-ad3a6d28-5e55-48d0-ba03-cecf549bf561 req-5dfe11e3-7149-4b13-a68f-093ed7e3d399 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051676 Apr 11 17:07:57 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 107/325] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:07:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1f5aa982-bc1d-4f1a-a330-27eca11c55c5 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:01 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-1f5aa982-bc1d-4f1a-a330-27eca11c55c5 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:01 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f5aa982-bc1d-4f1a-a330-27eca11c55c5 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f5aa982-bc1d-4f1a-a330-27eca11c55c5 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f5aa982-bc1d-4f1a-a330-27eca11c55c5 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f5aa982-bc1d-4f1a-a330-27eca11c55c5 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f5aa982-bc1d-4f1a-a330-27eca11c55c5 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f5aa982-bc1d-4f1a-a330-27eca11c55c5 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:01 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=23 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:01 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-1f5aa982-bc1d-4f1a-a330-27eca11c55c5 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-1f5aa982-bc1d-4f1a-a330-27eca11c55c5 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 200 len: 1703 microversion: 2.1 time: 0.165829 Apr 11 17:08:01 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 110/326] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:08:01 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 1703 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-bb8df7a6-e2ad-41b0-96e6-0b41c619a004 tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] Calling method '.version_select at 0x7f5bdd805f30>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-bb8df7a6-e2ad-41b0-96e6-0b41c619a004 tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5a385a98-f360-4782-ac2b-ea2bf5cf0783" status: 200 len: 351 microversion: 2.1 time: 0.055685 Apr 11 17:08:02 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 110/327] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:08:02 2023] GET /compute/v2.1/os-volumes/5a385a98-f360-4782-ac2b-ea2bf5cf0783 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:02 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "9ee63b2d-4336-4d8a-b449-9a11e36dd089"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:02 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:02 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:02 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'flavor' on Instance uuid 1289fdf8-8842-4e16-80dc-a287bc08fb02 {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:08:03 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-cd3ad800-e7d3-4590-a665-3465f9602d17 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02/action" status: 200 len: 29 microversion: 2.87 time: 0.563373 Apr 11 17:08:03 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 108/328] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 17:08:02 2023] POST /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02/action => generated 29 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:03 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:03 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:03 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:03 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:03 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:03 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-45b33950-ec20-4c06-8c44-0688457aa209 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02" status: 200 len: 1775 microversion: 2.87 time: 0.247238 Apr 11 17:08:03 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 111/329] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:08:03 2023] GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02 => generated 1775 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:08:03 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f98b540b-ea3e-41db-98fb-77d77729137b tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] Calling method '.version_select at 0x7f5bdd807400>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:03 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-f98b540b-ea3e-41db-98fb-77d77729137b tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d8675e16-50d5-4000-8526-61f4fa8f07bd" status: 200 len: 351 microversion: 2.1 time: 0.195753 Apr 11 17:08:03 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 111/330] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:08:03 2023] GET /compute/v2.1/os-volumes/d8675e16-50d5-4000-8526-61f4fa8f07bd => generated 351 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:03 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-unplugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:03 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] Creating event network-vif-unplugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:08:03 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-3fc63c41-0834-45e9-a552-e82971c70263 req-69c360cb-952b-4990-bd9e-31c646cbb8dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041604 Apr 11 17:08:03 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 109/331] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:05 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-0d536282-f32b-4e7a-b18c-37957b689fbd tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] Calling method '.version_select at 0x7f5bdda8e950>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:05 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-0d536282-f32b-4e7a-b18c-37957b689fbd tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/80ce9317-c351-4f6a-bc8d-a6d2298bf919" status: 200 len: 351 microversion: 2.1 time: 0.102957 Apr 11 17:08:05 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 112/332] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:08:05 2023] GET /compute/v2.1/os-volumes/80ce9317-c351-4f6a-bc8d-a6d2298bf919 => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:05 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2726cf4c-a6a1-4bf3-8fd6-a5488727961b tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] Calling method '.version_select at 0x7f5bdd806200>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-2726cf4c-a6a1-4bf3-8fd6-a5488727961b tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.083944 Apr 11 17:08:05 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 112/333] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 17:08:05 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:05 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-fc3f64f2-b010-4a0d-b649-768b4c75ce6c tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] Calling method '.version_select at 0x7f5bddc56f80>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:05 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-fc3f64f2-b010-4a0d-b649-768b4c75ce6c tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.319988 Apr 11 17:08:05 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 110/334] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Apr 11 17:08:05 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:05 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cfbbfa19-2c09-4afc-af5f-4240cbfac56a tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] Calling method '.version_select at 0x7f5bdda8fc70>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:05 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=5 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:05 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:06 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-plugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-cfbbfa19-2c09-4afc-af5f-4240cbfac56a tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.166117 Apr 11 17:08:06 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 113/335] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 17:08:05 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 17:08:06 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:06 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:06 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:06 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] Creating event network-vif-plugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:08:06 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-369a69a8-85f6-4915-bedc-37ac49d09c3a tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] Calling method '.version_select at 0x7f5bdd85a290>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:06 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-9b0892ab-cf33-493a-8453-99b8c2b8e1cb req-2da0c86e-d04d-45b5-aeb7-058bd3cc54bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043070 Apr 11 17:08:06 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 113/336] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:06 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-369a69a8-85f6-4915-bedc-37ac49d09c3a tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087414 Apr 11 17:08:06 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 111/337] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Apr 11 17:08:06 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:08:06 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2f7d3218-c4ad-4afd-9e55-e011714f0631 tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] Calling method '.version_select at 0x7f5bdda8c0d0>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-2f7d3218-c4ad-4afd-9e55-e011714f0631 tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.171879 Apr 11 17:08:06 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 114/338] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Apr 11 17:08:06 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:06 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2f33e353-5262-432e-b0d3-98f43ef77a55 tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] Calling method '.version_select at 0x7f5bdd806560>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:06 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-2f33e353-5262-432e-b0d3-98f43ef77a55 tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.147520 Apr 11 17:08:06 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 114/339] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 17:08:06 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:06 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-28db9ab4-e37a-476e-9aeb-5a737ccaa1d9 tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] Calling method '.version_select at 0x7f5bdd9c1120>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:06 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-28db9ab4-e37a-476e-9aeb-5a737ccaa1d9 tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087499 Apr 11 17:08:06 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 112/340] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Apr 11 17:08:06 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:06 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f86282a7-9db0-4dc4-a242-14457fd95110 tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] Calling method '.version_select at 0x7f5bddba8430>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f86282a7-9db0-4dc4-a242-14457fd95110 tempest-VolumesTestJSON-1304391965 tempest-VolumesTestJSON-1304391965-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.162918 Apr 11 17:08:06 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 115/341] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 17:08:06 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-plugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] Creating event network-vif-plugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:08:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-057bb995-332b-42f5-a3dd-9d41074405e0 req-e1e276df-f12c-4bff-8b71-a5c298d4c519 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043862 Apr 11 17:08:09 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:09 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-d5e6140f-f161-4670-beed-f366ccf40612 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:09 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-d5e6140f-f161-4670-beed-f366ccf40612 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d5e6140f-f161-4670-beed-f366ccf40612 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d5e6140f-f161-4670-beed-f366ccf40612 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d5e6140f-f161-4670-beed-f366ccf40612 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d5e6140f-f161-4670-beed-f366ccf40612 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d5e6140f-f161-4670-beed-f366ccf40612 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d5e6140f-f161-4670-beed-f366ccf40612 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:09 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-d5e6140f-f161-4670-beed-f366ccf40612 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f7d3b94cc6b4a7d95489d7d4cf6e297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4085a617084465ae810ff06498f992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:09 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-d5e6140f-f161-4670-beed-f366ccf40612 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995" status: 200 len: 1539 microversion: 2.1 time: 0.316504 Apr 11 17:08:09 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 113/343] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:08:09 2023] GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995 => generated 1539 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:11 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-plugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] Creating event network-vif-plugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:08:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-d241e83d-2b24-4cef-b695-bb029794cdec req-f9b96cef-4974-4d1e-9241-97b5a69e8bf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047559 Apr 11 17:08:11 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 116/344] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:15 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "fbe95301-4824-4367-bbd7-1481c81b25ff"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:15 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] HTTP exception thrown: Volume bdb848bd-c61b-4e21-888a-8ea8c6c24de6 could not be found. Apr 11 17:08:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Request method failure captured: Apr 11 17:08:16 user devstack@n-api.service[61422]: request: PUT /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/os-volume_attachments/bdb848bd-c61b-4e21-888a-8ea8c6c24de6 HTTP/1.1 Apr 11 17:08:16 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:08:16 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:08:16 user devstack@n-api.service[61422]: Connection: close Apr 11 17:08:16 user devstack@n-api.service[61422]: Content-Length: 74 Apr 11 17:08:16 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:08:16 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:08:16 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:08:16 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLdwVZe9xTn2EV8sAlQD8SlVh3GAjAfzXX7p9YI7_uI44A9oJYblprubM2m-zUr0qMROxXlbD42HMLca0re8Kh-FI_9wQblqpzTjnNl08s_hlpViGoQYlVkd7Mr2RBBWHXxS64eDCeBMvfYZmAwoVkq68SKp5OcN-UYdlrCVtdjQjk Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Project-Id: 0c87979fc29a4e71a854987def1a84fb Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Project-Name: tempest-VolumesAdminNegativeTest-966721324 Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Role: reader,member,admin Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Roles: reader,member,admin Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c87979fc29a4e71a854987def1a84fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0c87979fc29a4e71a854987def1a84fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0c87979fc29a4e71a854987def1a84fb"}]}] Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Tenant: tempest-VolumesAdminNegativeTest-966721324 Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Tenant-Id: 0c87979fc29a4e71a854987def1a84fb Apr 11 17:08:16 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-966721324 Apr 11 17:08:16 user devstack@n-api.service[61422]: X-User: tempest-VolumesAdminNegativeTest-966721324-project-admin Apr 11 17:08:16 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:08:16 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:08:16 user devstack@n-api.service[61422]: X-User-Id: c3d4d79b57e74885bc3b9a05a5f4b5a5 Apr 11 17:08:16 user devstack@n-api.service[61422]: X-User-Name: tempest-VolumesAdminNegativeTest-966721324-project-admin Apr 11 17:08:16 user devstack@n-api.service[61422]: Apr 11 17:08:16 user devstack@n-api.service[61422]: {"volumeAttachment": {"volumeId": "fbe95301-4824-4367-bbd7-1481c81b25ff"}} Apr 11 17:08:16 user devstack@n-api.service[61422]: method: > Apr 11 17:08:16 user devstack@n-api.service[61422]: exception: Volume bdb848bd-c61b-4e21-888a-8ea8c6c24de6 could not be found. Apr 11 17:08:16 user devstack@n-api.service[61422]: action_args: {'server_id': 'd136c0bb-535b-4d89-ba3a-a1306e0c8f1b', 'id': 'bdb848bd-c61b-4e21-888a-8ea8c6c24de6', 'body': {'volumeAttachment': {'volumeId': 'fbe95301-4824-4367-bbd7-1481c81b25ff'}}} Apr 11 17:08:16 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bdb848bd-c61b-4e21-888a-8ea8c6c24de6 could not be found. (HTTP 404) (Request-ID: req-42987381-9935-40f2-80b7-c193986076c5) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bdb848bd-c61b-4e21-888a-8ea8c6c24de6 could not be found. Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bdb848bd-c61b-4e21-888a-8ea8c6c24de6 could not be found. Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bdb848bd-c61b-4e21-888a-8ea8c6c24de6 could not be found. Apr 11 17:08:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:08:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] Returning 404 to user: Volume bdb848bd-c61b-4e21-888a-8ea8c6c24de6 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:08:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d3543dcf-125d-41b6-ac8b-bb07d78f89c9 tempest-VolumesAdminNegativeTest-966721324 tempest-VolumesAdminNegativeTest-966721324-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/os-volume_attachments/bdb848bd-c61b-4e21-888a-8ea8c6c24de6" status: 404 len: 109 microversion: 2.1 time: 0.130921 Apr 11 17:08:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 116/345] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 17:08:15 2023] PUT /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b/os-volume_attachments/bdb848bd-c61b-4e21-888a-8ea8c6c24de6 => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:08:17 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:17 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:17 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:08:17 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-17ad3d10-4790-4d81-bf5f-e9997a2abad7 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" status: 204 len: 0 microversion: 2.1 time: 0.136837 Apr 11 17:08:17 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 114/346] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:08:17 2023] DELETE /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:08:17 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-0bbf84b2-595b-4693-8550-274f8d0272a8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:17 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-0bbf84b2-595b-4693-8550-274f8d0272a8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0bbf84b2-595b-4693-8550-274f8d0272a8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0bbf84b2-595b-4693-8550-274f8d0272a8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0bbf84b2-595b-4693-8550-274f8d0272a8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0bbf84b2-595b-4693-8550-274f8d0272a8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0bbf84b2-595b-4693-8550-274f8d0272a8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0bbf84b2-595b-4693-8550-274f8d0272a8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:17 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0bbf84b2-595b-4693-8550-274f8d0272a8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd111d892e2944f279a36622978b2dd06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381738c7ad99437b875807c4252965bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:17 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-0bbf84b2-595b-4693-8550-274f8d0272a8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" status: 200 len: 1501 microversion: 2.1 time: 0.207521 Apr 11 17:08:17 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 117/347] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:08:17 2023] GET /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b => generated 1501 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b", "name": "network-vif-unplugged", "status": "completed", "tag": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] Creating event network-vif-unplugged:84508dcf-4b2a-4a8c-807f-12f73bf1fa0f for instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b on user Apr 11 17:08:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-8dd4545e-d625-465d-8c19-abc758aae63e req-ff47e57f-fc1d-4fa4-b3e9-1f2e929b8189 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034902 Apr 11 17:08:17 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 117/348] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:19 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-bc896473-8057-425c-922c-e3071a81e77f req-17df7638-c1a1-412f-8b84-c98a34a67a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b", "name": "network-vif-deleted", "tag": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bc896473-8057-425c-922c-e3071a81e77f req-17df7638-c1a1-412f-8b84-c98a34a67a26 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bc896473-8057-425c-922c-e3071a81e77f req-17df7638-c1a1-412f-8b84-c98a34a67a26 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bc896473-8057-425c-922c-e3071a81e77f req-17df7638-c1a1-412f-8b84-c98a34a67a26 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:19 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-bc896473-8057-425c-922c-e3071a81e77f req-17df7638-c1a1-412f-8b84-c98a34a67a26 service nova] Creating event network-vif-deleted:84508dcf-4b2a-4a8c-807f-12f73bf1fa0f for instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b on user Apr 11 17:08:19 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-bc896473-8057-425c-922c-e3071a81e77f req-17df7638-c1a1-412f-8b84-c98a34a67a26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187483 Apr 11 17:08:19 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 115/349] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:19 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d136c0bb-535b-4d89-ba3a-a1306e0c8f1b", "name": "network-vif-plugged", "status": "completed", "tag": "84508dcf-4b2a-4a8c-807f-12f73bf1fa0f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:19 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] Creating event network-vif-plugged:84508dcf-4b2a-4a8c-807f-12f73bf1fa0f for instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b on user Apr 11 17:08:19 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-376582c1-0162-4229-8e61-0352c923c656 req-a9242edf-0a25-4c5e-8df7-fb211a1d4060 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043481 Apr 11 17:08:19 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 118/350] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:22 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-cec6e96b-6c38-43ab-83ca-79934d48e81a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:22 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-cec6e96b-6c38-43ab-83ca-79934d48e81a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cec6e96b-6c38-43ab-83ca-79934d48e81a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cec6e96b-6c38-43ab-83ca-79934d48e81a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cec6e96b-6c38-43ab-83ca-79934d48e81a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cec6e96b-6c38-43ab-83ca-79934d48e81a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cec6e96b-6c38-43ab-83ca-79934d48e81a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cec6e96b-6c38-43ab-83ca-79934d48e81a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:22 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-cec6e96b-6c38-43ab-83ca-79934d48e81a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878fecd141a4c0f97ead618b9cfdcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab7d4c5adc544ef9ed9f774e1e144cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-cec6e96b-6c38-43ab-83ca-79934d48e81a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6" status: 200 len: 1494 microversion: 2.1 time: 0.217061 Apr 11 17:08:22 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 118/351] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:08:22 2023] GET /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6 => generated 1494 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:23 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ebedcd8e-a6c9-4ef4-9500-96f04fb6a3b4 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:23 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ebedcd8e-a6c9-4ef4-9500-96f04fb6a3b4 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebedcd8e-a6c9-4ef4-9500-96f04fb6a3b4 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebedcd8e-a6c9-4ef4-9500-96f04fb6a3b4 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebedcd8e-a6c9-4ef4-9500-96f04fb6a3b4 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebedcd8e-a6c9-4ef4-9500-96f04fb6a3b4 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebedcd8e-a6c9-4ef4-9500-96f04fb6a3b4 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebedcd8e-a6c9-4ef4-9500-96f04fb6a3b4 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:23 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ebedcd8e-a6c9-4ef4-9500-96f04fb6a3b4 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:23 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ebedcd8e-a6c9-4ef4-9500-96f04fb6a3b4 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705" status: 200 len: 1493 microversion: 2.1 time: 0.199364 Apr 11 17:08:23 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 116/352] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:08:23 2023] GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705 => generated 1493 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:25 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f51eda3d-4f2c-4f80-90f8-87e33f1031f1 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:25 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f51eda3d-4f2c-4f80-90f8-87e33f1031f1 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f51eda3d-4f2c-4f80-90f8-87e33f1031f1 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f51eda3d-4f2c-4f80-90f8-87e33f1031f1 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f51eda3d-4f2c-4f80-90f8-87e33f1031f1 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f51eda3d-4f2c-4f80-90f8-87e33f1031f1 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f51eda3d-4f2c-4f80-90f8-87e33f1031f1 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f51eda3d-4f2c-4f80-90f8-87e33f1031f1 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:25 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-f51eda3d-4f2c-4f80-90f8-87e33f1031f1 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea404079db924f70b4a22278cee452dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2f734d27a049e7b97ba50db0db0b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:25 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f51eda3d-4f2c-4f80-90f8-87e33f1031f1 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca" status: 200 len: 1434 microversion: 2.1 time: 0.195224 Apr 11 17:08:25 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 119/353] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:08:25 2023] GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca => generated 1434 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:40 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=10 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:40 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=16 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-753808701", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "5b226129-4389-4397-b183-5260af7d71bc"}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] validate_networks() for [('5b226129-4389-4397-b183-5260af7d71bc', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Getting quotas for project b39994062d984774a3755b822f9a2fa7. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Getting quotas for user f637a2235ae447dc83dc4b2eb5554bff and project b39994062d984774a3755b822f9a2fa7. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:08:41 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:08:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-f02bce80-d9c1-42d9-90f6-b384f7339f3e tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.676378 Apr 11 17:08:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 119/354] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:08:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:08:41 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:41 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:41 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2fd064da-6d36-4830-bff2-1ebde918ef10 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:41 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2fd064da-6d36-4830-bff2-1ebde918ef10 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:41 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-2fd064da-6d36-4830-bff2-1ebde918ef10 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f637a2235ae447dc83dc4b2eb5554bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39994062d984774a3755b822f9a2fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2fd064da-6d36-4830-bff2-1ebde918ef10 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c689a3c0-b429-49fd-9b20-eb73353ac0b1" status: 200 len: 1207 microversion: 2.1 time: 0.077319 Apr 11 17:08:41 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 117/355] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:08:41 2023] GET /compute/v2.1/servers/c689a3c0-b429-49fd-9b20-eb73353ac0b1 => generated 1207 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:42 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=13 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:42 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=27 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:42 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f4fd7c12-d4fb-40a6-b502-dfbc22982c5b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:42 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f4fd7c12-d4fb-40a6-b502-dfbc22982c5b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f4fd7c12-d4fb-40a6-b502-dfbc22982c5b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f4fd7c12-d4fb-40a6-b502-dfbc22982c5b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f4fd7c12-d4fb-40a6-b502-dfbc22982c5b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f4fd7c12-d4fb-40a6-b502-dfbc22982c5b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f4fd7c12-d4fb-40a6-b502-dfbc22982c5b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f4fd7c12-d4fb-40a6-b502-dfbc22982c5b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:43 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-f4fd7c12-d4fb-40a6-b502-dfbc22982c5b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:43 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f4fd7c12-d4fb-40a6-b502-dfbc22982c5b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c" status: 200 len: 1490 microversion: 2.1 time: 0.367051 Apr 11 17:08:43 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 120/356] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:08:42 2023] GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c => generated 1490 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:44 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c689a3c0-b429-49fd-9b20-eb73353ac0b1", "tag": "443112af-6269-4e46-b9d5-ee7645b57a4d"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] Creating event network-changed:443112af-6269-4e46-b9d5-ee7645b57a4d for instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 on user Apr 11 17:08:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-10adfd3c-6578-4349-9890-aea0e3c1c1fe req-c54799c9-5830-4e0e-8b8f-5c36024796db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029877 Apr 11 17:08:44 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 120/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:46 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c689a3c0-b429-49fd-9b20-eb73353ac0b1", "name": "network-vif-plugged", "status": "completed", "tag": "443112af-6269-4e46-b9d5-ee7645b57a4d"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:46 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] Creating event network-vif-plugged:443112af-6269-4e46-b9d5-ee7645b57a4d for instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 on user Apr 11 17:08:46 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-3bfe239e-b26f-4144-bb3d-ffe4bfc9846d req-cae47873-1497-44b8-b63c-9747d298608c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089649 Apr 11 17:08:46 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 118/358] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:48 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c689a3c0-b429-49fd-9b20-eb73353ac0b1", "name": "network-vif-plugged", "status": "completed", "tag": "443112af-6269-4e46-b9d5-ee7645b57a4d"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:48 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] Creating event network-vif-plugged:443112af-6269-4e46-b9d5-ee7645b57a4d for instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 on user Apr 11 17:08:48 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-4fec543e-ab55-4834-92fc-6cc7c04f3a02 req-b6e317e9-e6f1-4c38-b7dc-6ca8813b8c26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031678 Apr 11 17:08:48 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 121/359] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:53 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:08:53 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:53 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:53 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:53 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-789ffd7b-aa18-418c-abb3-6be60b97499e tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02" status: 200 len: 1755 microversion: 2.87 time: 0.303709 Apr 11 17:08:53 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 121/360] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:08:53 2023] GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02 => generated 1755 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:08:53 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-430688fe-78e0-4e35-b738-b0ee2185384e tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "POST /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/action" status: 202 len: 0 microversion: 2.1 time: 0.207678 Apr 11 17:08:53 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 119/361] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:08:53 2023] POST /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:08:53 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c4f4a25c-247f-48f6-8d74-ca342db3d378 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:53 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c4f4a25c-247f-48f6-8d74-ca342db3d378 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c4f4a25c-247f-48f6-8d74-ca342db3d378 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c4f4a25c-247f-48f6-8d74-ca342db3d378 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c4f4a25c-247f-48f6-8d74-ca342db3d378 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c4f4a25c-247f-48f6-8d74-ca342db3d378 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c4f4a25c-247f-48f6-8d74-ca342db3d378 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c4f4a25c-247f-48f6-8d74-ca342db3d378 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:53 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c4f4a25c-247f-48f6-8d74-ca342db3d378 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.106936 Apr 11 17:08:53 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 122/362] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:08:53 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-interface => generated 283 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:54 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-unplugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] Creating event network-vif-unplugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:08:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-71b2369d-a531-46a5-9f5f-bb4caf7670e2 req-f49d5a6e-153e-47c4-ba63-bf1675cba140 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039418 Apr 11 17:08:54 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 122/363] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:54 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] Creating event network-changed:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:08:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-9574463b-a0a9-463d-8156-9d836ec48bbd req-32890872-6c97-46cc-8a39-1c267d243a1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106821 Apr 11 17:08:54 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 120/364] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cf190846-572c-4e9a-b1a3-ae280bfd2558 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-cf190846-572c-4e9a-b1a3-ae280bfd2558 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf190846-572c-4e9a-b1a3-ae280bfd2558 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf190846-572c-4e9a-b1a3-ae280bfd2558 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf190846-572c-4e9a-b1a3-ae280bfd2558 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf190846-572c-4e9a-b1a3-ae280bfd2558 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf190846-572c-4e9a-b1a3-ae280bfd2558 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf190846-572c-4e9a-b1a3-ae280bfd2558 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-cf190846-572c-4e9a-b1a3-ae280bfd2558 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:56 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-cf190846-572c-4e9a-b1a3-ae280bfd2558 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1722 microversion: 2.1 time: 0.327520 Apr 11 17:08:56 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 123/365] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:08:55 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1722 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:56 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-99bca5df-b890-421a-bde4-f84f06dda6b4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:08:56 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-99bca5df-b890-421a-bde4-f84f06dda6b4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:08:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99bca5df-b890-421a-bde4-f84f06dda6b4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99bca5df-b890-421a-bde4-f84f06dda6b4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99bca5df-b890-421a-bde4-f84f06dda6b4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99bca5df-b890-421a-bde4-f84f06dda6b4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99bca5df-b890-421a-bde4-f84f06dda6b4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99bca5df-b890-421a-bde4-f84f06dda6b4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:56 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-99bca5df-b890-421a-bde4-f84f06dda6b4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:08:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-99bca5df-b890-421a-bde4-f84f06dda6b4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1722 microversion: 2.1 time: 0.223469 Apr 11 17:08:56 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 123/366] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:08:56 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:08:56 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-plugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:56 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:56 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:56 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:56 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] Creating event network-vif-plugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:08:56 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-e060ecb0-5444-42cd-b567-0f9a2b807c64 req-b434096f-1426-46b0-be71-5505bd826727 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057213 Apr 11 17:08:56 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 121/367] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:56 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] Creating event network-changed:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:08:56 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-da341adb-c325-4567-9e62-53f8817cd7c0 req-800ac2f7-3948-47d7-a26f-595d138a2fe5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032920 Apr 11 17:08:56 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 124/368] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:08:58 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-plugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}, {"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-plugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:08:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:08:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:08:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:08:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Creating event network-vif-plugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:08:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] Creating event network-vif-plugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:08:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5090cc0f-810a-4bfc-9202-624e32b3e680 req-2332e0a0-7d87-4414-8736-4dcf96e2ee8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036639 Apr 11 17:08:58 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 124/369] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:08:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:02 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:02 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:02 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'services' on Instance uuid d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:09:02 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2fcdaacc-bcf2-4e84-be50-a9ac7f205dbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/os-volume_attachments/c9628077-d981-481d-a434-92ba15259efd" status: 202 len: 0 microversion: 2.1 time: 0.288841 Apr 11 17:09:02 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 122/370] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:09:02 2023] DELETE /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/os-volume_attachments/c9628077-d981-481d-a434-92ba15259efd => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:09:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:04 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Going to try to stop instance {{(pid=61424) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 17:09:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-3f669a5e-612e-4b6e-99e8-59a9a7ad338c tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/action" status: 202 len: 0 microversion: 2.1 time: 0.122438 Apr 11 17:09:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 125/371] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:09:04 2023] POST /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:09:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8fa54e06-bb2b-4857-8258-e30eb7182cee tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:04 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8fa54e06-bb2b-4857-8258-e30eb7182cee tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8fa54e06-bb2b-4857-8258-e30eb7182cee tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8fa54e06-bb2b-4857-8258-e30eb7182cee tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8fa54e06-bb2b-4857-8258-e30eb7182cee tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8fa54e06-bb2b-4857-8258-e30eb7182cee tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8fa54e06-bb2b-4857-8258-e30eb7182cee tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8fa54e06-bb2b-4857-8258-e30eb7182cee tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:04 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-8fa54e06-bb2b-4857-8258-e30eb7182cee tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8fa54e06-bb2b-4857-8258-e30eb7182cee tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 200 len: 1667 microversion: 2.1 time: 0.210284 Apr 11 17:09:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 125/372] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:04 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 1667 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:09:05 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-unplugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:05 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] Creating event network-vif-unplugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:09:05 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-9b1ca77b-4a3c-4570-9a03-ec4990d1805f req-a5d0eac5-4bd5-4ba8-8658-9e258e4ba673 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036400 Apr 11 17:09:05 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 123/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:07 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}, {"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}, {"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}, {"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-unplugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}, {"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:09:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:09:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:09:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Creating event network-vif-unplugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:09:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:09:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-8fa3dd01-65e5-4621-895d-49aeb7f15667 req-ad1286ab-15c4-4b90-b91d-b5db7d2e1af7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.046438 Apr 11 17:09:07 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 126/374] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:07 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:07 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: d136c0bb-535b-4d89-ba3a-a1306e0c8f1b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] HTTP exception thrown: Instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b could not be found. Apr 11 17:09:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Request method failure captured: Apr 11 17:09:07 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b HTTP/1.1 Apr 11 17:09:07 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:09:07 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:09:07 user devstack@n-api.service[61422]: Connection: close Apr 11 17:09:07 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:09:07 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:09:07 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:09:07 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:09:07 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLIDpeqUy6sYuPWleTbeDkTr5Xn6bY5QyjIeZ9FwEXb0JJPmE4rcdMo3xmzv-1oe0w7yPRKGHwUfLFTnxTwRKFgBYm13u3ursDKoukcT8xRKCtD-cwLa7WD50DD8T0331QFfv23dRIgdhyLkWQzEMlE1NYBok4e-x7pbLdfggcLs1c Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Project-Id: 381738c7ad99437b875807c4252965bf Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Project-Name: tempest-VolumesAdminNegativeTest-1639987679 Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/381738c7ad99437b875807c4252965bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/381738c7ad99437b875807c4252965bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/381738c7ad99437b875807c4252965bf"}]}] Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Tenant: tempest-VolumesAdminNegativeTest-1639987679 Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Tenant-Id: 381738c7ad99437b875807c4252965bf Apr 11 17:09:07 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1639987679 Apr 11 17:09:07 user devstack@n-api.service[61422]: X-User: tempest-VolumesAdminNegativeTest-1639987679-project-member Apr 11 17:09:07 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:09:07 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:09:07 user devstack@n-api.service[61422]: X-User-Id: d111d892e2944f279a36622978b2dd06 Apr 11 17:09:07 user devstack@n-api.service[61422]: X-User-Name: tempest-VolumesAdminNegativeTest-1639987679-project-member Apr 11 17:09:07 user devstack@n-api.service[61422]: method: > Apr 11 17:09:07 user devstack@n-api.service[61422]: exception: Instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b could not be found. Apr 11 17:09:07 user devstack@n-api.service[61422]: action_args: {'id': 'd136c0bb-535b-4d89-ba3a-a1306e0c8f1b'} Apr 11 17:09:07 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b could not be found. Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b could not be found. Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b could not be found. Apr 11 17:09:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Returning 404 to user: Instance d136c0bb-535b-4d89-ba3a-a1306e0c8f1b could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:09:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d6bdb8ff-6765-430d-b271-0c878862841a tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b" status: 404 len: 111 microversion: 2.1 time: 0.169199 Apr 11 17:09:07 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 126/375] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:07 2023] GET /compute/v2.1/servers/d136c0bb-535b-4d89-ba3a-a1306e0c8f1b => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:09:09 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-346d78ed-5969-49ab-8c12-d11059d51ddd tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" status: 204 len: 0 microversion: 2.1 time: 0.127975 Apr 11 17:09:09 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 124/376] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:09:09 2023] DELETE /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:09:09 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-5d6ff3f2-8edb-4256-ba71-f5dacfe76cb8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:09 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-5d6ff3f2-8edb-4256-ba71-f5dacfe76cb8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5d6ff3f2-8edb-4256-ba71-f5dacfe76cb8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5d6ff3f2-8edb-4256-ba71-f5dacfe76cb8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5d6ff3f2-8edb-4256-ba71-f5dacfe76cb8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5d6ff3f2-8edb-4256-ba71-f5dacfe76cb8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5d6ff3f2-8edb-4256-ba71-f5dacfe76cb8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5d6ff3f2-8edb-4256-ba71-f5dacfe76cb8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:09 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-5d6ff3f2-8edb-4256-ba71-f5dacfe76cb8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd111d892e2944f279a36622978b2dd06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381738c7ad99437b875807c4252965bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:09 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-5d6ff3f2-8edb-4256-ba71-f5dacfe76cb8 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" status: 200 len: 1669 microversion: 2.1 time: 0.219285 Apr 11 17:09:09 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 127/377] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:09 2023] GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e => generated 1669 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:09:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e", "name": "network-vif-unplugged", "status": "completed", "tag": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] Creating event network-vif-unplugged:68bea989-7c25-4d4d-aa6d-e4fe977ebb93 for instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e on user Apr 11 17:09:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-d4124821-0379-4188-837e-1683376628b1 req-7270354d-d8b6-4ebd-9ff7-ef2ba93194d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037532 Apr 11 17:09:09 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 127/378] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-22595811-24fc-4b97-91ee-a8ca65cca80e tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-22595811-24fc-4b97-91ee-a8ca65cca80e tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-22595811-24fc-4b97-91ee-a8ca65cca80e tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-22595811-24fc-4b97-91ee-a8ca65cca80e tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-22595811-24fc-4b97-91ee-a8ca65cca80e tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-22595811-24fc-4b97-91ee-a8ca65cca80e tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-22595811-24fc-4b97-91ee-a8ca65cca80e tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-22595811-24fc-4b97-91ee-a8ca65cca80e tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:10 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-22595811-24fc-4b97-91ee-a8ca65cca80e tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f7d3b94cc6b4a7d95489d7d4cf6e297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4085a617084465ae810ff06498f992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-22595811-24fc-4b97-91ee-a8ca65cca80e tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995" status: 200 len: 1539 microversion: 2.1 time: 0.371878 Apr 11 17:09:10 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 125/379] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:09 2023] GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995 => generated 1539 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:09:11 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-7aa0e2f3-d5ab-4fb3-ae84-015983445592 req-9ffb53ed-ba73-470d-8fdc-b0363ab664d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e", "name": "network-vif-deleted", "tag": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7aa0e2f3-d5ab-4fb3-ae84-015983445592 req-9ffb53ed-ba73-470d-8fdc-b0363ab664d7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7aa0e2f3-d5ab-4fb3-ae84-015983445592 req-9ffb53ed-ba73-470d-8fdc-b0363ab664d7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7aa0e2f3-d5ab-4fb3-ae84-015983445592 req-9ffb53ed-ba73-470d-8fdc-b0363ab664d7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-7aa0e2f3-d5ab-4fb3-ae84-015983445592 req-9ffb53ed-ba73-470d-8fdc-b0363ab664d7 service nova] Creating event network-vif-deleted:68bea989-7c25-4d4d-aa6d-e4fe977ebb93 for instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e on user Apr 11 17:09:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-7aa0e2f3-d5ab-4fb3-ae84-015983445592 req-9ffb53ed-ba73-470d-8fdc-b0363ab664d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041834 Apr 11 17:09:11 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 128/380] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:09:11 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e", "name": "network-vif-plugged", "status": "completed", "tag": "68bea989-7c25-4d4d-aa6d-e4fe977ebb93"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:11 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:11 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=31 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] Creating event network-vif-plugged:68bea989-7c25-4d4d-aa6d-e4fe977ebb93 for instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e on user Apr 11 17:09:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-7db2debc-6fce-4d13-9a3e-3619cb7757a5 req-86e72cad-1790-4cb6-81b6-4de16886ab06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039876 Apr 11 17:09:11 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 128/381] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:12 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b7642b-356d-4122-b006-fe7681192995", "tag": "24930491-6f3c-445d-ad6b-c4d37775783a"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:12 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:12 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:12 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] Creating event network-changed:24930491-6f3c-445d-ad6b-c4d37775783a for instance 43b7642b-356d-4122-b006-fe7681192995 on user Apr 11 17:09:12 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-a48ce31f-3ebb-41f8-b5c5-5ad7dbbcaf2f req-c9855dd4-0c38-406d-8c7a-7b65ddcf970d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043591 Apr 11 17:09:12 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 126/382] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b69b905-7b1c-4197-aeb4-beb66f68d83c"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:12 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:12 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-cbd06403-3e0f-48b0-bcbe-7630b9d0bdf7 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "POST /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372222 Apr 11 17:09:12 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 129/383] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:09:12 2023] POST /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:19 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:19 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:19 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lazy-loading 'services' on Instance uuid 43b7642b-356d-4122-b006-fe7681192995 {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:09:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c9e3d99f-c214-4842-a60b-e2b546dee56d tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995/os-volume_attachments/0b69b905-7b1c-4197-aeb4-beb66f68d83c" status: 202 len: 0 microversion: 2.1 time: 0.181195 Apr 11 17:09:19 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 129/384] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:09:19 2023] DELETE /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995/os-volume_attachments/0b69b905-7b1c-4197-aeb4-beb66f68d83c => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:09:19 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-fc54d199-d381-41cd-a61a-3490ad544898 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:19 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-fc54d199-d381-41cd-a61a-3490ad544898 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fc54d199-d381-41cd-a61a-3490ad544898 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fc54d199-d381-41cd-a61a-3490ad544898 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fc54d199-d381-41cd-a61a-3490ad544898 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fc54d199-d381-41cd-a61a-3490ad544898 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fc54d199-d381-41cd-a61a-3490ad544898 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fc54d199-d381-41cd-a61a-3490ad544898 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:19 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-fc54d199-d381-41cd-a61a-3490ad544898 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056815 Apr 11 17:09:19 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 127/385] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:09:19 2023] GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:22 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=20 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:22 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:22 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cf1c524-aa18-4ad4-8b51-04ecc1def139", "device": "/dev/vdb"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:22 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:23 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-69c3950f-9c71-4df2-858d-dc417737658a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319956 Apr 11 17:09:23 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 130/386] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:09:22 2023] POST /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:23 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1556364363", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "fc5f2351-9e4e-4481-9745-87fe310d86e2"}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:23 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] validate_networks() for [('fc5f2351-9e4e-4481-9745-87fe310d86e2', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Getting quotas for project d1c61fd594564317a51c9dadebbba6c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Getting quotas for user d0c53186c18940aba415e0b999cbc2a0 and project d1c61fd594564317a51c9dadebbba6c7. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:09:24 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:09:24 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e99e83c2-b93c-438d-b034-833a52785f3c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.597908 Apr 11 17:09:24 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 130/387] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:09:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:09:24 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-1aea9ee3-6ab8-4fcb-b8e2-cbe341a49e99 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:24 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-1aea9ee3-6ab8-4fcb-b8e2-cbe341a49e99 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:24 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-1aea9ee3-6ab8-4fcb-b8e2-cbe341a49e99 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:24 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-1aea9ee3-6ab8-4fcb-b8e2-cbe341a49e99 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c" status: 200 len: 1211 microversion: 2.1 time: 0.071377 Apr 11 17:09:24 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 128/388] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:24 2023] GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c => generated 1211 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:09:25 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-99c50447-df00-49c9-9507-a67c6bbc83a5 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:25 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-99c50447-df00-49c9-9507-a67c6bbc83a5 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99c50447-df00-49c9-9507-a67c6bbc83a5 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99c50447-df00-49c9-9507-a67c6bbc83a5 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99c50447-df00-49c9-9507-a67c6bbc83a5 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99c50447-df00-49c9-9507-a67c6bbc83a5 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99c50447-df00-49c9-9507-a67c6bbc83a5 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99c50447-df00-49c9-9507-a67c6bbc83a5 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:26 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-99c50447-df00-49c9-9507-a67c6bbc83a5 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea404079db924f70b4a22278cee452dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2f734d27a049e7b97ba50db0db0b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-99c50447-df00-49c9-9507-a67c6bbc83a5 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca" status: 200 len: 1434 microversion: 2.1 time: 0.436496 Apr 11 17:09:26 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 131/389] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:25 2023] GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca => generated 1434 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:09:26 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:26 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:26 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lazy-loading 'services' on Instance uuid 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:09:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7eef7a15-31c7-40e0-ae7a-71fdbdb3d863 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-volume_attachments/924a836a-8dba-4bec-aa59-5cc6250874bc" status: 202 len: 0 microversion: 2.1 time: 0.192739 Apr 11 17:09:26 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 131/390] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:09:26 2023] DELETE /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-volume_attachments/924a836a-8dba-4bec-aa59-5cc6250874bc => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:09:26 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2e7e9c8b-16a3-4605-bd4d-73ec468f454c tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:26 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2e7e9c8b-16a3-4605-bd4d-73ec468f454c tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e7e9c8b-16a3-4605-bd4d-73ec468f454c tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e7e9c8b-16a3-4605-bd4d-73ec468f454c tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e7e9c8b-16a3-4605-bd4d-73ec468f454c tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e7e9c8b-16a3-4605-bd4d-73ec468f454c tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e7e9c8b-16a3-4605-bd4d-73ec468f454c tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e7e9c8b-16a3-4605-bd4d-73ec468f454c tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:26 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2e7e9c8b-16a3-4605-bd4d-73ec468f454c tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045328 Apr 11 17:09:26 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 129/391] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:09:26 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:27 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] Creating event network-changed:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:09:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-7ac959f0-bc8e-4f4e-aaa2-69ede942683e req-408935b2-c799-49ae-b602-cd16b1726f47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037220 Apr 11 17:09:27 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 132/392] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "351fca73-83de-49b4-91d8-72e3cf45a59c", "tag": "fe19475b-d2f0-4f2a-814c-dc6650833ff5"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] Creating event network-changed:fe19475b-d2f0-4f2a-814c-dc6650833ff5 for instance 351fca73-83de-49b4-91d8-72e3cf45a59c on user Apr 11 17:09:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-45733b55-7bc3-4879-91bc-fe308ac614b4 req-3be71ac9-5ca0-4d51-a435-c8d3c3bac51d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040223 Apr 11 17:09:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 132/393] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:28 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:28 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lazy-loading 'flavor' on Instance uuid dba29188-c963-44d4-95fa-09bffbcb8dca {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:09:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-7621f8f7-66ed-47ed-aa2e-c6cab4b9dd3f tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca/action" status: 202 len: 0 microversion: 2.1 time: 0.104956 Apr 11 17:09:28 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 130/394] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:09:28 2023] POST /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 17:09:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-0ed07598-fe60-4ac0-984f-24cab67435f0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:28 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-0ed07598-fe60-4ac0-984f-24cab67435f0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0ed07598-fe60-4ac0-984f-24cab67435f0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0ed07598-fe60-4ac0-984f-24cab67435f0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0ed07598-fe60-4ac0-984f-24cab67435f0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0ed07598-fe60-4ac0-984f-24cab67435f0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0ed07598-fe60-4ac0-984f-24cab67435f0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0ed07598-fe60-4ac0-984f-24cab67435f0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:28 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0ed07598-fe60-4ac0-984f-24cab67435f0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea404079db924f70b4a22278cee452dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2f734d27a049e7b97ba50db0db0b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-0ed07598-fe60-4ac0-984f-24cab67435f0 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca" status: 200 len: 1440 microversion: 2.1 time: 0.277544 Apr 11 17:09:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 133/395] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:28 2023] GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca => generated 1440 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:09:30 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "name": "network-vif-unplugged", "status": "completed", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}, {"server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "name": "network-vif-plugged", "status": "completed", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Creating event network-vif-unplugged:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:09:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] Creating event network-vif-plugged:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:09:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-96ef418e-10d9-4721-a9e9-53add73ece72 req-db11e3d7-1dfb-4a08-8aef-e3a3921820ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034189 Apr 11 17:09:30 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 133/396] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:30 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] Creating event network-changed:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:09:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-3296e3b2-ac87-4ca8-8e68-01ce1c503bed req-134b8bf3-7e2b-4987-930d-af0fa06c948a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054810 Apr 11 17:09:30 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 131/397] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-873fb4e9-f597-4bce-9d86-a87b825a8ca7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:31 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-873fb4e9-f597-4bce-9d86-a87b825a8ca7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-873fb4e9-f597-4bce-9d86-a87b825a8ca7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-873fb4e9-f597-4bce-9d86-a87b825a8ca7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-873fb4e9-f597-4bce-9d86-a87b825a8ca7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-873fb4e9-f597-4bce-9d86-a87b825a8ca7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-873fb4e9-f597-4bce-9d86-a87b825a8ca7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-873fb4e9-f597-4bce-9d86-a87b825a8ca7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:31 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-873fb4e9-f597-4bce-9d86-a87b825a8ca7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f637a2235ae447dc83dc4b2eb5554bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39994062d984774a3755b822f9a2fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-873fb4e9-f597-4bce-9d86-a87b825a8ca7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c689a3c0-b429-49fd-9b20-eb73353ac0b1" status: 200 len: 1485 microversion: 2.1 time: 0.174022 Apr 11 17:09:31 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 134/398] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:31 2023] GET /compute/v2.1/servers/c689a3c0-b429-49fd-9b20-eb73353ac0b1 => generated 1485 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:09:32 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351fca73-83de-49b4-91d8-72e3cf45a59c", "name": "network-vif-plugged", "status": "completed", "tag": "fe19475b-d2f0-4f2a-814c-dc6650833ff5"}, {"server_uuid": "351fca73-83de-49b4-91d8-72e3cf45a59c", "name": "network-vif-plugged", "status": "completed", "tag": "fe19475b-d2f0-4f2a-814c-dc6650833ff5"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:32 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Creating event network-vif-plugged:fe19475b-d2f0-4f2a-814c-dc6650833ff5 for instance 351fca73-83de-49b4-91d8-72e3cf45a59c on user Apr 11 17:09:32 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] Creating event network-vif-plugged:fe19475b-d2f0-4f2a-814c-dc6650833ff5 for instance 351fca73-83de-49b4-91d8-72e3cf45a59c on user Apr 11 17:09:32 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-f40973c7-ee42-4067-bb07-20d6eaa2df23 req-059299c3-3b12-46d0-bbee-4693e2e56005 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047111 Apr 11 17:09:32 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 134/399] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:38 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:38 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:38 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:38 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'services' on Instance uuid cfbf4deb-df22-4546-b215-61afb77efcc6 {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:09:38 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-a706470c-72ac-4e72-bd9a-ead9ac68420a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6/os-volume_attachments/2cf1c524-aa18-4ad4-8b51-04ecc1def139" status: 202 len: 0 microversion: 2.1 time: 0.228693 Apr 11 17:09:38 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 132/400] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:09:38 2023] DELETE /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6/os-volume_attachments/2cf1c524-aa18-4ad4-8b51-04ecc1def139 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:09:38 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:38 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:38 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:09:38 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-49e54ec5-d314-4ec9-b766-1a96e1f118e3 tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6" status: 204 len: 0 microversion: 2.1 time: 0.135131 Apr 11 17:09:38 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 135/401] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:09:38 2023] DELETE /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:09:38 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:38 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:38 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5ec5dac4-2c2c-49bc-9ae2-765de9869dda tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:38 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-5ec5dac4-2c2c-49bc-9ae2-765de9869dda tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5ec5dac4-2c2c-49bc-9ae2-765de9869dda tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5ec5dac4-2c2c-49bc-9ae2-765de9869dda tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5ec5dac4-2c2c-49bc-9ae2-765de9869dda tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5ec5dac4-2c2c-49bc-9ae2-765de9869dda tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5ec5dac4-2c2c-49bc-9ae2-765de9869dda tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5ec5dac4-2c2c-49bc-9ae2-765de9869dda tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:38 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-5ec5dac4-2c2c-49bc-9ae2-765de9869dda tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878fecd141a4c0f97ead618b9cfdcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab7d4c5adc544ef9ed9f774e1e144cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-5ec5dac4-2c2c-49bc-9ae2-765de9869dda tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6" status: 200 len: 1546 microversion: 2.1 time: 0.155310 Apr 11 17:09:38 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 135/402] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:38 2023] GET /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:09:40 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf4deb-df22-4546-b215-61afb77efcc6", "name": "network-vif-unplugged", "status": "completed", "tag": "65b16011-5edc-4a36-9493-4ad587afbc19"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:40 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] Creating event network-vif-unplugged:65b16011-5edc-4a36-9493-4ad587afbc19 for instance cfbf4deb-df22-4546-b215-61afb77efcc6 on user Apr 11 17:09:40 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-92e2d422-7273-44f2-b140-5d884920206b req-84da180e-f4c5-4fc7-93fd-e1a8f51ba8f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048284 Apr 11 17:09:40 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 133/403] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:42 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfbf4deb-df22-4546-b215-61afb77efcc6", "name": "network-vif-plugged", "status": "completed", "tag": "65b16011-5edc-4a36-9493-4ad587afbc19"}, {"server_uuid": "cfbf4deb-df22-4546-b215-61afb77efcc6", "name": "network-vif-deleted", "tag": "65b16011-5edc-4a36-9493-4ad587afbc19"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] Creating event network-vif-plugged:65b16011-5edc-4a36-9493-4ad587afbc19 for instance cfbf4deb-df22-4546-b215-61afb77efcc6 on user Apr 11 17:09:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] Creating event network-vif-deleted:65b16011-5edc-4a36-9493-4ad587afbc19 for instance cfbf4deb-df22-4546-b215-61afb77efcc6 on user Apr 11 17:09:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-a2679e97-f28e-42d4-8ca4-adcb50094921 req-793bebf8-2c42-4281-99cd-5cd427cde7ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046761 Apr 11 17:09:42 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 136/404] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d340f744-6d66-4434-9b34-8b2856665658"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:43 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 25935a69-292b-4d55-932c-f4893838998c while it is in vm_state rescued Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Request method failure captured: Apr 11 17:09:43 user devstack@n-api.service[61422]: request: POST /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c/os-volume_attachments HTTP/1.1 Apr 11 17:09:43 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:09:43 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:09:43 user devstack@n-api.service[61422]: Connection: close Apr 11 17:09:43 user devstack@n-api.service[61422]: Content-Length: 74 Apr 11 17:09:43 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:09:43 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:09:43 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:09:43 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLG_8768-mQu9yCs4bl3OD1M7pFG45ape6z4ER5iPMh2_4MVeL8_JC_PQr_wQldSevDB4n3fAHGtPfGRkhDLtbmOK0lOZKqOM-mism8v_CCvVElUL8QJRBymW1T6rq6VlnL9Bw8r7y3LHYzyoUDFyNZbhaisWcl1Vc1hXgwyF33jcU Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Project-Id: 16e55c9209ac4b11b5af5ec1ad14d8b5 Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}] Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Tenant-Id: 16e55c9209ac4b11b5af5ec1ad14d8b5 Apr 11 17:09:43 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:09:43 user devstack@n-api.service[61422]: X-User: tempest-ServerRescueNegativeTestJSON-1553918933-project-member Apr 11 17:09:43 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:09:43 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:09:43 user devstack@n-api.service[61422]: X-User-Id: 3666d19053684843b400aab6ebf29cce Apr 11 17:09:43 user devstack@n-api.service[61422]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1553918933-project-member Apr 11 17:09:43 user devstack@n-api.service[61422]: Apr 11 17:09:43 user devstack@n-api.service[61422]: {"volumeAttachment": {"volumeId": "d340f744-6d66-4434-9b34-8b2856665658"}} Apr 11 17:09:43 user devstack@n-api.service[61422]: method: > Apr 11 17:09:43 user devstack@n-api.service[61422]: exception: Cannot 'attach_volume' instance 25935a69-292b-4d55-932c-f4893838998c while it is in vm_state rescued Apr 11 17:09:43 user devstack@n-api.service[61422]: action_args: {'server_id': '25935a69-292b-4d55-932c-f4893838998c', 'body': {'volumeAttachment': {'volumeId': 'd340f744-6d66-4434-9b34-8b2856665658'}}} Apr 11 17:09:43 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 25935a69-292b-4d55-932c-f4893838998c in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 25935a69-292b-4d55-932c-f4893838998c while it is in vm_state rescued Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 25935a69-292b-4d55-932c-f4893838998c while it is in vm_state rescued Apr 11 17:09:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:43 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Returning 409 to user: Cannot 'attach_volume' instance 25935a69-292b-4d55-932c-f4893838998c while it is in vm_state rescued {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:09:43 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-bef102f0-ef7c-4146-854f-2bfafd76b1c2 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049810 Apr 11 17:09:43 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 136/405] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:09:43 2023] POST /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 17:09:43 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:43 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:43 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=18 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-aecc15e4-9749-44c7-8c74-5fdcc128e40a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c/action" status: 202 len: 0 microversion: 2.1 time: 0.088668 Apr 11 17:09:43 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 134/406] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:09:43 2023] POST /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:09:43 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-428b14cb-d368-4bbd-bf81-3e94a8aee006 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:43 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-428b14cb-d368-4bbd-bf81-3e94a8aee006 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-428b14cb-d368-4bbd-bf81-3e94a8aee006 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-428b14cb-d368-4bbd-bf81-3e94a8aee006 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-428b14cb-d368-4bbd-bf81-3e94a8aee006 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-428b14cb-d368-4bbd-bf81-3e94a8aee006 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-428b14cb-d368-4bbd-bf81-3e94a8aee006 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-428b14cb-d368-4bbd-bf81-3e94a8aee006 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:43 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-428b14cb-d368-4bbd-bf81-3e94a8aee006 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:43 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-428b14cb-d368-4bbd-bf81-3e94a8aee006 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c" status: 200 len: 1498 microversion: 2.1 time: 0.166470 Apr 11 17:09:43 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 137/407] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:43 2023] GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:09:44 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-unplugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] Creating event network-vif-unplugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:09:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-41a59c6e-a13d-4fd9-a1ca-f51b21ba7fae req-04c010ec-5656-42cb-850c-571b3e7ca6f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030935 Apr 11 17:09:44 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 137/408] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:46 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-plugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}, {"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-plugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}, {"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-plugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:46 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Creating event network-vif-plugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:09:46 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Creating event network-vif-plugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:09:46 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] Creating event network-vif-plugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:09:46 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-6e8c582f-61d5-447e-8f37-3ff49f098c9b req-81e96f3b-cd2d-40e2-8092-7aa5b68d0392 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034753 Apr 11 17:09:46 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 135/409] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:46 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:53 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:53 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:53 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:53 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:53 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:53 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-287344c1-e44c-4bc3-9507-01de1349a381 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02/action" status: 202 len: 0 microversion: 2.87 time: 0.093258 Apr 11 17:09:53 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 138/410] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 17:09:53 2023] POST /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:09:53 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:53 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:54 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:54 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:54 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-102a8777-2a6e-42ca-9479-572b42dc7097 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02" status: 200 len: 1763 microversion: 2.87 time: 0.860469 Apr 11 17:09:54 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 138/411] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:09:53 2023] GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02 => generated 1763 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:09:54 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b8cfbe0b-6cfd-42b0-9ee3-0b4d45729d45 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:54 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-b8cfbe0b-6cfd-42b0-9ee3-0b4d45729d45 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b8cfbe0b-6cfd-42b0-9ee3-0b4d45729d45 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b8cfbe0b-6cfd-42b0-9ee3-0b4d45729d45 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b8cfbe0b-6cfd-42b0-9ee3-0b4d45729d45 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b8cfbe0b-6cfd-42b0-9ee3-0b4d45729d45 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b8cfbe0b-6cfd-42b0-9ee3-0b4d45729d45 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b8cfbe0b-6cfd-42b0-9ee3-0b4d45729d45 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:55 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:09:55 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-b8cfbe0b-6cfd-42b0-9ee3-0b4d45729d45 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:09:55 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-b8cfbe0b-6cfd-42b0-9ee3-0b4d45729d45 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 200 len: 1644 microversion: 2.1 time: 0.163255 Apr 11 17:09:55 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 136/412] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:54 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 1644 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:09:55 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-unplugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] Creating event network-vif-unplugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:09:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-241c68f7-d1f3-4da5-b64e-339a6d457ded req-715216b2-77e6-4d30-8b9a-ca6e76499f80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031095 Apr 11 17:09:55 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 139/413] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:56 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:56 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:56 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lazy-loading 'services' on Instance uuid 1fc7677c-cbd9-48e7-be62-2210074bc87a {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:09:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ab307156-e364-415c-a348-cc8ea5d69cfe tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments/24daff67-0055-44fd-8be9-acf4b3f77ff5" status: 202 len: 0 microversion: 2.1 time: 0.234586 Apr 11 17:09:56 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 139/414] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:09:56 2023] DELETE /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments/24daff67-0055-44fd-8be9-acf4b3f77ff5 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:09:56 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-c5ade52b-2e30-46e8-bb68-edf149b03beb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:56 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-c5ade52b-2e30-46e8-bb68-edf149b03beb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:56 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c5ade52b-2e30-46e8-bb68-edf149b03beb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:56 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c5ade52b-2e30-46e8-bb68-edf149b03beb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:56 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c5ade52b-2e30-46e8-bb68-edf149b03beb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:56 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c5ade52b-2e30-46e8-bb68-edf149b03beb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:56 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c5ade52b-2e30-46e8-bb68-edf149b03beb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:56 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c5ade52b-2e30-46e8-bb68-edf149b03beb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:57 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-c5ade52b-2e30-46e8-bb68-edf149b03beb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Apr 11 17:09:57 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 137/415] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:09:56 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:57 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-plugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:57 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] Creating event network-vif-plugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:09:57 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-dc6106ab-0224-46fc-9dc9-82f31f3b8d6f req-1b2b5ef9-d8ae-4107-9d25-eaf5e94d4576 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031643 Apr 11 17:09:57 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 140/416] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:59 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:59 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] [instance: 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:09:59 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-plugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}, {"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-plugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:09:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:59 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:09:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:09:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:09:59 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] HTTP exception thrown: Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e could not be found. Apr 11 17:09:59 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Creating event network-vif-plugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:09:59 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] Creating event network-vif-plugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:09:59 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Request method failure captured: Apr 11 17:09:59 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e HTTP/1.1 Apr 11 17:09:59 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:09:59 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:09:59 user devstack@n-api.service[61422]: Connection: close Apr 11 17:09:59 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:09:59 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:09:59 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:09:59 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:09:59 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLIDpeqUy6sYuPWleTbeDkTr5Xn6bY5QyjIeZ9FwEXb0JJPmE4rcdMo3xmzv-1oe0w7yPRKGHwUfLFTnxTwRKFgBYm13u3ursDKoukcT8xRKCtD-cwLa7WD50DD8T0331QFfv23dRIgdhyLkWQzEMlE1NYBok4e-x7pbLdfggcLs1c Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Project-Id: 381738c7ad99437b875807c4252965bf Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Project-Name: tempest-VolumesAdminNegativeTest-1639987679 Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/381738c7ad99437b875807c4252965bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/381738c7ad99437b875807c4252965bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/381738c7ad99437b875807c4252965bf"}]}] Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Tenant: tempest-VolumesAdminNegativeTest-1639987679 Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Tenant-Id: 381738c7ad99437b875807c4252965bf Apr 11 17:09:59 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1639987679 Apr 11 17:09:59 user devstack@n-api.service[61422]: X-User: tempest-VolumesAdminNegativeTest-1639987679-project-member Apr 11 17:09:59 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:09:59 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:09:59 user devstack@n-api.service[61422]: X-User-Id: d111d892e2944f279a36622978b2dd06 Apr 11 17:09:59 user devstack@n-api.service[61422]: X-User-Name: tempest-VolumesAdminNegativeTest-1639987679-project-member Apr 11 17:09:59 user devstack@n-api.service[61422]: method: > Apr 11 17:09:59 user devstack@n-api.service[61422]: exception: Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e could not be found. Apr 11 17:09:59 user devstack@n-api.service[61422]: action_args: {'id': '2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e'} Apr 11 17:09:59 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e could not be found. Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e could not be found. Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e could not be found. Apr 11 17:09:59 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:09:59 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-1fb028ba-6253-49b4-9e14-161093213f82 req-aaaab6a2-b294-4237-85c8-eb4cd8a67165 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032195 Apr 11 17:09:59 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 138/417] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:09:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:09:59 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Returning 404 to user: Instance 2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:09:59 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-a758d98d-2e2d-4c4b-a8ae-ea314525c5a1 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e" status: 404 len: 111 microversion: 2.1 time: 0.042440 Apr 11 17:09:59 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 140/418] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:09:59 2023] GET /compute/v2.1/servers/2edf68ba-04a4-4aa1-a720-d0ac98dfdd0e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:09:59 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-911237dc-07a9-4af2-bde7-12c5188be7e2 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] Calling method '.version_select at 0x7f5bdd922b90>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:09:59 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-911237dc-07a9-4af2-bde7-12c5188be7e2 tempest-VolumesAdminNegativeTest-1639987679 tempest-VolumesAdminNegativeTest-1639987679-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343943661" status: 202 len: 0 microversion: 2.1 time: 0.026537 Apr 11 17:09:59 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 141/419] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 17:09:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1343943661 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:10:09 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-39335986-24ad-4f9d-bdf6-bb2993ee5e32 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:09 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-39335986-24ad-4f9d-bdf6-bb2993ee5e32 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:09 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=9 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:09 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=13 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-39335986-24ad-4f9d-bdf6-bb2993ee5e32 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-39335986-24ad-4f9d-bdf6-bb2993ee5e32 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-39335986-24ad-4f9d-bdf6-bb2993ee5e32 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-39335986-24ad-4f9d-bdf6-bb2993ee5e32 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-39335986-24ad-4f9d-bdf6-bb2993ee5e32 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-39335986-24ad-4f9d-bdf6-bb2993ee5e32 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:09 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-39335986-24ad-4f9d-bdf6-bb2993ee5e32 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053541 Apr 11 17:10:09 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 139/420] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:10:09 2023] GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:10:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:10 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:10 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=11 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:10 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b7642b-356d-4122-b006-fe7681192995", "tag": "24930491-6f3c-445d-ad6b-c4d37775783a"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:10 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:10 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] Creating event network-changed:24930491-6f3c-445d-ad6b-c4d37775783a for instance 43b7642b-356d-4122-b006-fe7681192995 on user Apr 11 17:10:10 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:10:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-54f36678-63ec-49a7-b3bd-4d37d9db92b9 req-899a9024-c36a-489f-a653-5dad47a17303 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039510 Apr 11 17:10:10 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 142/421] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:10:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-cff7394e-b6ad-400b-b1c2-49c0c3d7e977 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995" status: 204 len: 0 microversion: 2.1 time: 0.128042 Apr 11 17:10:10 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 141/422] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:10:10 2023] DELETE /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:10:10 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ed7540b9-cd80-48e7-b09e-d6d328cb01e3 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ed7540b9-cd80-48e7-b09e-d6d328cb01e3 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ed7540b9-cd80-48e7-b09e-d6d328cb01e3 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ed7540b9-cd80-48e7-b09e-d6d328cb01e3 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ed7540b9-cd80-48e7-b09e-d6d328cb01e3 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ed7540b9-cd80-48e7-b09e-d6d328cb01e3 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ed7540b9-cd80-48e7-b09e-d6d328cb01e3 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ed7540b9-cd80-48e7-b09e-d6d328cb01e3 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:10 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ed7540b9-cd80-48e7-b09e-d6d328cb01e3 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f7d3b94cc6b4a7d95489d7d4cf6e297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4085a617084465ae810ff06498f992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ed7540b9-cd80-48e7-b09e-d6d328cb01e3 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995" status: 200 len: 1664 microversion: 2.1 time: 0.197186 Apr 11 17:10:10 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 140/423] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:10 2023] GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995 => generated 1664 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:10:11 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b7642b-356d-4122-b006-fe7681192995", "name": "network-vif-unplugged", "status": "completed", "tag": "24930491-6f3c-445d-ad6b-c4d37775783a"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] Creating event network-vif-unplugged:24930491-6f3c-445d-ad6b-c4d37775783a for instance 43b7642b-356d-4122-b006-fe7681192995 on user Apr 11 17:10:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-a23be376-4bb9-4d81-bda5-ef14abaa6e42 req-ecdda8ac-2a88-4793-8fcb-48c252aaf9fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030220 Apr 11 17:10:11 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 143/424] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:12 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-1bb864dc-0991-400e-82d9-1266247c0f79 req-f7b72023-1ffe-4550-b5d5-df77ab5bf197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b7642b-356d-4122-b006-fe7681192995", "name": "network-vif-deleted", "tag": "24930491-6f3c-445d-ad6b-c4d37775783a"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1bb864dc-0991-400e-82d9-1266247c0f79 req-f7b72023-1ffe-4550-b5d5-df77ab5bf197 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1bb864dc-0991-400e-82d9-1266247c0f79 req-f7b72023-1ffe-4550-b5d5-df77ab5bf197 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1bb864dc-0991-400e-82d9-1266247c0f79 req-f7b72023-1ffe-4550-b5d5-df77ab5bf197 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-1bb864dc-0991-400e-82d9-1266247c0f79 req-f7b72023-1ffe-4550-b5d5-df77ab5bf197 service nova] Creating event network-vif-deleted:24930491-6f3c-445d-ad6b-c4d37775783a for instance 43b7642b-356d-4122-b006-fe7681192995 on user Apr 11 17:10:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-1bb864dc-0991-400e-82d9-1266247c0f79 req-f7b72023-1ffe-4550-b5d5-df77ab5bf197 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030831 Apr 11 17:10:12 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 142/425] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:13 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b7642b-356d-4122-b006-fe7681192995", "name": "network-vif-plugged", "status": "completed", "tag": "24930491-6f3c-445d-ad6b-c4d37775783a"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:13 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] Creating event network-vif-plugged:24930491-6f3c-445d-ad6b-c4d37775783a for instance 43b7642b-356d-4122-b006-fe7681192995 on user Apr 11 17:10:13 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-23d19038-791d-4a79-a399-add9e36ddc10 req-5650f637-32e5-42d4-aea8-af3eaa3c5548 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033111 Apr 11 17:10:13 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 141/426] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:14 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-10644ed3-b3c3-41fe-86ea-2a55144d96ab tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:14 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-10644ed3-b3c3-41fe-86ea-2a55144d96ab tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-10644ed3-b3c3-41fe-86ea-2a55144d96ab tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-10644ed3-b3c3-41fe-86ea-2a55144d96ab tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-10644ed3-b3c3-41fe-86ea-2a55144d96ab tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-10644ed3-b3c3-41fe-86ea-2a55144d96ab tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-10644ed3-b3c3-41fe-86ea-2a55144d96ab tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-10644ed3-b3c3-41fe-86ea-2a55144d96ab tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:14 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-10644ed3-b3c3-41fe-86ea-2a55144d96ab tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:14 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-10644ed3-b3c3-41fe-86ea-2a55144d96ab tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c" status: 200 len: 1495 microversion: 2.1 time: 0.256698 Apr 11 17:10:14 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 144/427] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:14 2023] GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c => generated 1495 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:10:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9f55806e-ed7a-470e-8aae-e377338a3a04 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:16 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9f55806e-ed7a-470e-8aae-e377338a3a04 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f55806e-ed7a-470e-8aae-e377338a3a04 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f55806e-ed7a-470e-8aae-e377338a3a04 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f55806e-ed7a-470e-8aae-e377338a3a04 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f55806e-ed7a-470e-8aae-e377338a3a04 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f55806e-ed7a-470e-8aae-e377338a3a04 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f55806e-ed7a-470e-8aae-e377338a3a04 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9f55806e-ed7a-470e-8aae-e377338a3a04 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048372 Apr 11 17:10:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 143/428] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:10:16 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:10:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-c10f1ef3-2544-49c3-a5b8-56146377034c tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '.version_select at 0x7f5bdd9c2b00>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:18 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-c10f1ef3-2544-49c3-a5b8-56146377034c tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/092f4818-05d2-4f43-becf-b000e59860ae" status: 204 len: 0 microversion: 2.1 time: 0.317807 Apr 11 17:10:18 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 142/429] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:18 2023] DELETE /compute/v2.1/images/092f4818-05d2-4f43-becf-b000e59860ae => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:10:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-bf555b8e-fe4a-4a3b-bfb2-5f60573e19a0 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" status: 204 len: 0 microversion: 2.1 time: 0.120966 Apr 11 17:10:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 145/430] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:10:18 2023] DELETE /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:10:18 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-14e0a5f1-3022-4177-bc8f-df883775569b tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:18 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-14e0a5f1-3022-4177-bc8f-df883775569b tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-14e0a5f1-3022-4177-bc8f-df883775569b tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-14e0a5f1-3022-4177-bc8f-df883775569b tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-14e0a5f1-3022-4177-bc8f-df883775569b tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-14e0a5f1-3022-4177-bc8f-df883775569b tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-14e0a5f1-3022-4177-bc8f-df883775569b tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-14e0a5f1-3022-4177-bc8f-df883775569b tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-de8b88a6-c778-4d56-a155-593eb110bcfc tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:18 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-de8b88a6-c778-4d56-a155-593eb110bcfc tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:18 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-14e0a5f1-3022-4177-bc8f-df883775569b tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6126b468bd2414d831b105a3429ddd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b803e7cf929440298b14cd3177c96e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de8b88a6-c778-4d56-a155-593eb110bcfc tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de8b88a6-c778-4d56-a155-593eb110bcfc tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:18 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-14e0a5f1-3022-4177-bc8f-df883775569b tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" status: 200 len: 1677 microversion: 2.1 time: 0.156655 Apr 11 17:10:18 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 144/431] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:18 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:10:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de8b88a6-c778-4d56-a155-593eb110bcfc tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de8b88a6-c778-4d56-a155-593eb110bcfc tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de8b88a6-c778-4d56-a155-593eb110bcfc tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de8b88a6-c778-4d56-a155-593eb110bcfc tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-unplugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] Creating event network-vif-unplugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:10:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-3d1e745e-a5b3-4f2b-80a6-a965a22d6cbf req-5e4d4d34-3f09-4083-923c-87cf2c5e7fd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032060 Apr 11 17:10:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 146/432] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:18 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-de8b88a6-c778-4d56-a155-593eb110bcfc tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea404079db924f70b4a22278cee452dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2f734d27a049e7b97ba50db0db0b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:19 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-de8b88a6-c778-4d56-a155-593eb110bcfc tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca" status: 200 len: 1500 microversion: 2.1 time: 0.352572 Apr 11 17:10:19 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 143/433] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:18 2023] GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca => generated 1500 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:10:20 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-a404eb3d-634e-47b3-9968-2d9574a78e61 req-b08f4d3c-068d-40f3-a104-3574e7fae924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-deleted", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-a404eb3d-634e-47b3-9968-2d9574a78e61 req-b08f4d3c-068d-40f3-a104-3574e7fae924 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-a404eb3d-634e-47b3-9968-2d9574a78e61 req-b08f4d3c-068d-40f3-a104-3574e7fae924 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-a404eb3d-634e-47b3-9968-2d9574a78e61 req-b08f4d3c-068d-40f3-a104-3574e7fae924 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-a404eb3d-634e-47b3-9968-2d9574a78e61 req-b08f4d3c-068d-40f3-a104-3574e7fae924 service nova] Creating event network-vif-deleted:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:10:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-a404eb3d-634e-47b3-9968-2d9574a78e61 req-b08f4d3c-068d-40f3-a104-3574e7fae924 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029353 Apr 11 17:10:20 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 145/434] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:20 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f03f63-a491-4fd4-a282-a4e9b5b6aa2e", "name": "network-vif-plugged", "status": "completed", "tag": "34535545-332f-47ea-b110-74b5f957388e"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:20 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] Creating event network-vif-plugged:34535545-332f-47ea-b110-74b5f957388e for instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e on user Apr 11 17:10:20 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-59a5c71e-ec27-4efc-9a0f-673cb06823b6 req-ffb5d3a3-8d8c-4987-8cfa-b5fa2ce9f7ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032101 Apr 11 17:10:20 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 147/435] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:27 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a99f87a8-6647-4c07-a99e-cae4fd93f674 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd9c1240>, body: {"keypair": {"name": "tempest-keypair-1138093427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWPNfbCaEwA3hS4hBZfqeIb2/vGoibGS4jgGeMaTuGLZjpqRp+NKSGZy1QEnjwtnmTx2SmfNGaUkRaTr/Y1hjtEyd9uDXIaTlZSoUDZM4Q6+vTKLn4FmzLzxOb+3iqRPg=="}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:27 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-a99f87a8-6647-4c07-a99e-cae4fd93f674 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Getting quotas for project ec2d39b4dbd0440c93734b0bab463b11. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:10:27 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-a99f87a8-6647-4c07-a99e-cae4fd93f674 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Getting quotas for user 1a78f1b0eaee488f89af2d7d82cd9e08 and project ec2d39b4dbd0440c93734b0bab463b11. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:10:27 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-a99f87a8-6647-4c07-a99e-cae4fd93f674 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.048654 Apr 11 17:10:27 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 144/436] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 17:10:27 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 17:10:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1021636219", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a52cb4ad-0152-403f-97c9-ea2bd1366b97"}], "security_groups": [{"name": "tempest-securitygroup--2099980681"}], "key_name": "tempest-keypair-1138093427", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:28 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: cfbf4deb-df22-4546-b215-61afb77efcc6] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] HTTP exception thrown: Instance cfbf4deb-df22-4546-b215-61afb77efcc6 could not be found. Apr 11 17:10:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Request method failure captured: Apr 11 17:10:28 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6 HTTP/1.1 Apr 11 17:10:28 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:10:28 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:10:28 user devstack@n-api.service[61424]: Connection: close Apr 11 17:10:28 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:10:28 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:10:28 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:10:28 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:10:28 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZPOSRNar875e6xDQ-Z9Cge2_6QCbcQ0G2pcTRPbJTQXcmW5pV3M7Rxf239mChpPUrV1JLk24QMgWcoaYKbOZTv08hM98Wv6o8U5CS1tvBCdCUEcgsfpWbELAkL4C86ENwMIVlYof6ieKS8Dcmj14NwMk_q6Sqd32QoJGROeGrtLLIw Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Project-Id: 3ab7d4c5adc544ef9ed9f774e1e144cc Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1455403265 Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ab7d4c5adc544ef9ed9f774e1e144cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ab7d4c5adc544ef9ed9f774e1e144cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ab7d4c5adc544ef9ed9f774e1e144cc"}]}] Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Tenant: tempest-VolumesSnapshotTestJSON-1455403265 Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Tenant-Id: 3ab7d4c5adc544ef9ed9f774e1e144cc Apr 11 17:10:28 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1455403265 Apr 11 17:10:28 user devstack@n-api.service[61424]: X-User: tempest-VolumesSnapshotTestJSON-1455403265-project-member Apr 11 17:10:28 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:10:28 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:10:28 user devstack@n-api.service[61424]: X-User-Id: 2878fecd141a4c0f97ead618b9cfdcbf Apr 11 17:10:28 user devstack@n-api.service[61424]: X-User-Name: tempest-VolumesSnapshotTestJSON-1455403265-project-member Apr 11 17:10:28 user devstack@n-api.service[61424]: method: > Apr 11 17:10:28 user devstack@n-api.service[61424]: exception: Instance cfbf4deb-df22-4546-b215-61afb77efcc6 could not be found. Apr 11 17:10:28 user devstack@n-api.service[61424]: action_args: {'id': 'cfbf4deb-df22-4546-b215-61afb77efcc6'} Apr 11 17:10:28 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfbf4deb-df22-4546-b215-61afb77efcc6 could not be found. Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfbf4deb-df22-4546-b215-61afb77efcc6 could not be found. Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfbf4deb-df22-4546-b215-61afb77efcc6 could not be found. Apr 11 17:10:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:10:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Returning 404 to user: Instance cfbf4deb-df22-4546-b215-61afb77efcc6 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:10:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f6d2662f-3a53-4bbf-93a3-8d58e919158c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6" status: 404 len: 111 microversion: 2.1 time: 0.032815 Apr 11 17:10:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 148/437] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:28 2023] GET /compute/v2.1/servers/cfbf4deb-df22-4546-b215-61afb77efcc6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:10:28 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] validate_networks() for [('a52cb4ad-0152-403f-97c9-ea2bd1366b97', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Getting quotas for project ec2d39b4dbd0440c93734b0bab463b11. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Getting quotas for user 1a78f1b0eaee488f89af2d7d82cd9e08 and project ec2d39b4dbd0440c93734b0bab463b11. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:10:29 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:10:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8136aa75-74da-4049-82d2-dd9c7e4ec081 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 0.621621 Apr 11 17:10:29 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 146/438] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 17:10:28 2023] POST /compute/v2.1/servers => generated 404 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 17:10:29 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=20 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:29 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-af965413-4dfa-40ce-a3e4-015978e45889 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:29 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-af965413-4dfa-40ce-a3e4-015978e45889 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:29 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-af965413-4dfa-40ce-a3e4-015978e45889 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:29 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-af965413-4dfa-40ce-a3e4-015978e45889 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:29 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-af965413-4dfa-40ce-a3e4-015978e45889 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:29 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-af965413-4dfa-40ce-a3e4-015978e45889 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a" status: 200 len: 1321 microversion: 2.49 time: 0.082389 Apr 11 17:10:29 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 145/439] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:10:29 2023] GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a => generated 1321 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:10:32 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "tag": "d5605470-2058-46dd-bc30-a8f0ba8c82db"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:32 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] Creating event network-changed:d5605470-2058-46dd-bc30-a8f0ba8c82db for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:10:32 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-4e0a4bbc-11d6-4ef0-a163-31be1cef103a req-f51382a9-ab14-4cd1-be15-308bb65ce0e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038885 Apr 11 17:10:32 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 149/440] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8c680392-e7cc-4dd8-9ae7-99ed1131fa05 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:33 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8c680392-e7cc-4dd8-9ae7-99ed1131fa05 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c680392-e7cc-4dd8-9ae7-99ed1131fa05 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c680392-e7cc-4dd8-9ae7-99ed1131fa05 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c680392-e7cc-4dd8-9ae7-99ed1131fa05 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c680392-e7cc-4dd8-9ae7-99ed1131fa05 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c680392-e7cc-4dd8-9ae7-99ed1131fa05 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c680392-e7cc-4dd8-9ae7-99ed1131fa05 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:33 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-8c680392-e7cc-4dd8-9ae7-99ed1131fa05 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8c680392-e7cc-4dd8-9ae7-99ed1131fa05 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c" status: 200 len: 1504 microversion: 2.1 time: 0.150431 Apr 11 17:10:33 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 147/441] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:33 2023] GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:10:33 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-802621587", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:33 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] validate_networks() for [('cf1a6f71-dd27-40d8-b7c3-3a01511fdfc3', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Getting quotas for project 3ab7d4c5adc544ef9ed9f774e1e144cc. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Getting quotas for user 2878fecd141a4c0f97ead618b9cfdcbf and project 3ab7d4c5adc544ef9ed9f774e1e144cc. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:10:34 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:10:34 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-dd611f41-26bd-4e16-9ef1-a7f7552e320c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.634560 Apr 11 17:10:34 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 146/442] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:10:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:10:34 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2a742adb-e831-4313-aab0-0ef56b97feca tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:34 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-2a742adb-e831-4313-aab0-0ef56b97feca tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:34 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-2a742adb-e831-4313-aab0-0ef56b97feca tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878fecd141a4c0f97ead618b9cfdcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab7d4c5adc544ef9ed9f774e1e144cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:34 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-2a742adb-e831-4313-aab0-0ef56b97feca tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300" status: 200 len: 1212 microversion: 2.1 time: 0.076437 Apr 11 17:10:34 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 150/443] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:34 2023] GET /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300 => generated 1212 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:10:34 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-plugged", "status": "completed", "tag": "d5605470-2058-46dd-bc30-a8f0ba8c82db"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] Creating event network-vif-plugged:d5605470-2058-46dd-bc30-a8f0ba8c82db for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:10:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-433c485e-8a67-4703-9bae-f75d2ca6a2bd req-dac7f5d9-0df6-41ba-b362-99d420c901f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046753 Apr 11 17:10:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 148/444] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:35 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:35 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:10:35 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-79ab282d-c811-448b-85f7-727c9fa23fa4 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c689a3c0-b429-49fd-9b20-eb73353ac0b1" status: 204 len: 0 microversion: 2.1 time: 0.143494 Apr 11 17:10:35 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 147/445] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:10:35 2023] DELETE /compute/v2.1/servers/c689a3c0-b429-49fd-9b20-eb73353ac0b1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:10:35 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-0728398d-1f66-4b6a-8f65-6e995420a2d7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:35 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-0728398d-1f66-4b6a-8f65-6e995420a2d7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0728398d-1f66-4b6a-8f65-6e995420a2d7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0728398d-1f66-4b6a-8f65-6e995420a2d7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0728398d-1f66-4b6a-8f65-6e995420a2d7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0728398d-1f66-4b6a-8f65-6e995420a2d7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0728398d-1f66-4b6a-8f65-6e995420a2d7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0728398d-1f66-4b6a-8f65-6e995420a2d7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:36 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0728398d-1f66-4b6a-8f65-6e995420a2d7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f637a2235ae447dc83dc4b2eb5554bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b39994062d984774a3755b822f9a2fa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:36 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-0728398d-1f66-4b6a-8f65-6e995420a2d7 tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c689a3c0-b429-49fd-9b20-eb73353ac0b1" status: 200 len: 1491 microversion: 2.1 time: 0.223310 Apr 11 17:10:36 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 151/446] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:35 2023] GET /compute/v2.1/servers/c689a3c0-b429-49fd-9b20-eb73353ac0b1 => generated 1491 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:10:36 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c689a3c0-b429-49fd-9b20-eb73353ac0b1", "name": "network-vif-unplugged", "status": "completed", "tag": "443112af-6269-4e46-b9d5-ee7645b57a4d"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] Creating event network-vif-unplugged:443112af-6269-4e46-b9d5-ee7645b57a4d for instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 on user Apr 11 17:10:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-04dab78f-89c9-4444-9bea-8a24e8ac5d8c req-2a214396-fd21-4b4e-b8b3-d3581b9e26b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030115 Apr 11 17:10:36 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 149/447] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-plugged", "status": "completed", "tag": "d5605470-2058-46dd-bc30-a8f0ba8c82db"}, {"server_uuid": "c689a3c0-b429-49fd-9b20-eb73353ac0b1", "name": "network-vif-deleted", "tag": "443112af-6269-4e46-b9d5-ee7645b57a4d"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] Creating event network-vif-plugged:d5605470-2058-46dd-bc30-a8f0ba8c82db for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:10:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] Creating event network-vif-deleted:443112af-6269-4e46-b9d5-ee7645b57a4d for instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 on user Apr 11 17:10:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-de6633cb-d940-41e7-9906-cbac4bdb4872 req-60b63c41-e83b-4aa7-ac33-f530e7a23fb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035558 Apr 11 17:10:37 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 148/448] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:38 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c689a3c0-b429-49fd-9b20-eb73353ac0b1", "name": "network-vif-plugged", "status": "completed", "tag": "443112af-6269-4e46-b9d5-ee7645b57a4d"}, {"name": "network-changed", "server_uuid": "5132062e-f602-4568-83ed-bc6fa2890300", "tag": "3cb911aa-7791-4ad0-af48-0e70fcd29e68"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:38 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Creating event network-vif-plugged:443112af-6269-4e46-b9d5-ee7645b57a4d for instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 on user Apr 11 17:10:38 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] Creating event network-changed:3cb911aa-7791-4ad0-af48-0e70fcd29e68 for instance 5132062e-f602-4568-83ed-bc6fa2890300 on user Apr 11 17:10:38 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-436a3fc0-0905-4755-8c69-1b5253d07604 req-9613c2f5-b242-4ad9-a183-264c1b086114 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037215 Apr 11 17:10:38 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 152/449] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:38 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:39 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:39 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:39 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5132062e-f602-4568-83ed-bc6fa2890300", "name": "network-vif-plugged", "status": "completed", "tag": "3cb911aa-7791-4ad0-af48-0e70fcd29e68"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] Creating event network-vif-plugged:3cb911aa-7791-4ad0-af48-0e70fcd29e68 for instance 5132062e-f602-4568-83ed-bc6fa2890300 on user Apr 11 17:10:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-e279383f-224b-42ac-9c09-cfe9ecd7e76b req-48db1ae5-ca1e-4824-8b0a-e9400086731c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037079 Apr 11 17:10:39 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 150/450] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:41 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5132062e-f602-4568-83ed-bc6fa2890300", "name": "network-vif-plugged", "status": "completed", "tag": "3cb911aa-7791-4ad0-af48-0e70fcd29e68"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:41 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] Creating event network-vif-plugged:3cb911aa-7791-4ad0-af48-0e70fcd29e68 for instance 5132062e-f602-4568-83ed-bc6fa2890300 on user Apr 11 17:10:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-ee48a39d-5331-4b0f-9408-0b72578d92ff req-6e0965b9-394e-4812-b4ee-aeaeb2e143a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045221 Apr 11 17:10:41 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 149/451] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:44 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:44 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-e9fa67a6-1e23-498c-a451-e7bef4bbe52a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02" status: 200 len: 1769 microversion: 2.87 time: 0.195040 Apr 11 17:10:44 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 153/452] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:10:44 2023] GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02 => generated 1769 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a747fca7-5d77-4d64-a5c3-4dd68c15945d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a747fca7-5d77-4d64-a5c3-4dd68c15945d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a747fca7-5d77-4d64-a5c3-4dd68c15945d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a747fca7-5d77-4d64-a5c3-4dd68c15945d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a747fca7-5d77-4d64-a5c3-4dd68c15945d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a747fca7-5d77-4d64-a5c3-4dd68c15945d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a747fca7-5d77-4d64-a5c3-4dd68c15945d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a747fca7-5d77-4d64-a5c3-4dd68c15945d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-a747fca7-5d77-4d64-a5c3-4dd68c15945d tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050127 Apr 11 17:10:47 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 151/453] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:10:47 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:10:47 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:47 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=12 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-7ed2ee46-f240-4c3f-b6eb-f17e1351cf4a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:47 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-7ed2ee46-f240-4c3f-b6eb-f17e1351cf4a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7ed2ee46-f240-4c3f-b6eb-f17e1351cf4a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7ed2ee46-f240-4c3f-b6eb-f17e1351cf4a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7ed2ee46-f240-4c3f-b6eb-f17e1351cf4a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7ed2ee46-f240-4c3f-b6eb-f17e1351cf4a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7ed2ee46-f240-4c3f-b6eb-f17e1351cf4a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7ed2ee46-f240-4c3f-b6eb-f17e1351cf4a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:47 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-7ed2ee46-f240-4c3f-b6eb-f17e1351cf4a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:47 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-7ed2ee46-f240-4c3f-b6eb-f17e1351cf4a tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1676 microversion: 2.1 time: 0.181236 Apr 11 17:10:47 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 150/454] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:47 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 17:10:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-0d6b62fe-a6d5-4e18-bffb-658631a60992 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:47 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-0d6b62fe-a6d5-4e18-bffb-658631a60992 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d6b62fe-a6d5-4e18-bffb-658631a60992 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d6b62fe-a6d5-4e18-bffb-658631a60992 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d6b62fe-a6d5-4e18-bffb-658631a60992 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d6b62fe-a6d5-4e18-bffb-658631a60992 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d6b62fe-a6d5-4e18-bffb-658631a60992 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d6b62fe-a6d5-4e18-bffb-658631a60992 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:47 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0d6b62fe-a6d5-4e18-bffb-658631a60992 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:47 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-0d6b62fe-a6d5-4e18-bffb-658631a60992 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1676 microversion: 2.1 time: 0.152277 Apr 11 17:10:47 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 154/455] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:47 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3e24bd29-eb4a-4430-86c8-287e02e566ed tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-3e24bd29-eb4a-4430-86c8-287e02e566ed tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3e24bd29-eb4a-4430-86c8-287e02e566ed tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3e24bd29-eb4a-4430-86c8-287e02e566ed tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3e24bd29-eb4a-4430-86c8-287e02e566ed tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3e24bd29-eb4a-4430-86c8-287e02e566ed tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3e24bd29-eb4a-4430-86c8-287e02e566ed tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3e24bd29-eb4a-4430-86c8-287e02e566ed tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:47 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-3e24bd29-eb4a-4430-86c8-287e02e566ed tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3e24bd29-eb4a-4430-86c8-287e02e566ed tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1676 microversion: 2.1 time: 0.143821 Apr 11 17:10:47 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 152/456] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:47 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1676 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:10:55 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:55 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Going to try to start instance {{(pid=61423) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 17:10:55 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-39d43b68-a704-48c0-855b-a57f1c4ff1b7 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/action" status: 202 len: 0 microversion: 2.1 time: 0.106684 Apr 11 17:10:55 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 151/457] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:10:55 2023] POST /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:10:55 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3ee34818-6268-4f81-acdc-123eaf171f69 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:10:55 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-3ee34818-6268-4f81-acdc-123eaf171f69 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:10:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3ee34818-6268-4f81-acdc-123eaf171f69 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3ee34818-6268-4f81-acdc-123eaf171f69 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3ee34818-6268-4f81-acdc-123eaf171f69 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3ee34818-6268-4f81-acdc-123eaf171f69 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3ee34818-6268-4f81-acdc-123eaf171f69 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3ee34818-6268-4f81-acdc-123eaf171f69 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:55 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-3ee34818-6268-4f81-acdc-123eaf171f69 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:10:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-3ee34818-6268-4f81-acdc-123eaf171f69 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 200 len: 1653 microversion: 2.1 time: 0.157823 Apr 11 17:10:55 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 155/458] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:10:55 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 1653 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:10:58 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:10:58 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:58 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=11 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:10:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:10:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:10:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:10:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:10:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-7c2462df-9f9f-4384-bff1-c54d779cc6f6 req-aa0e1138-f386-4db6-9b9d-8d76b6dd5ef3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035207 Apr 11 17:10:58 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 153/459] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:10:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:00 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:11:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-6877d9d3-14d9-4031-b070-79932e51b6a9 req-c3f38b2f-26cc-4eea-8da9-b3320bda9206 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031902 Apr 11 17:11:00 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 152/460] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:01 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 43b7642b-356d-4122-b006-fe7681192995] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] HTTP exception thrown: Instance 43b7642b-356d-4122-b006-fe7681192995 could not be found. Apr 11 17:11:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Request method failure captured: Apr 11 17:11:01 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995 HTTP/1.1 Apr 11 17:11:01 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:11:01 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:11:01 user devstack@n-api.service[61424]: Connection: close Apr 11 17:11:01 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:11:01 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:11:01 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:11:01 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:11:01 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZMBMU6M01-VPqaySTM-nTESdBZmuZzIy8i9v2ExZXLaGKsY7fDPWYmrzCAdr87rW2toyMao_Hh-CEkH9W9R8ZiokkTvscNoU7ybsgcoSktG0QXe_nOgnlrM4gbgfEXqc-dc-VrzTmmN7mNxAqMFmMr2RPOErVPgKAh8DH57g0E0pGs Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Project-Id: ec4085a617084465ae810ff06498f992 Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Project-Name: tempest-TestStampPattern-1846780226 Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec4085a617084465ae810ff06498f992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec4085a617084465ae810ff06498f992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec4085a617084465ae810ff06498f992"}]}] Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Tenant: tempest-TestStampPattern-1846780226 Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Tenant-Id: ec4085a617084465ae810ff06498f992 Apr 11 17:11:01 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-TestStampPattern-1846780226 Apr 11 17:11:01 user devstack@n-api.service[61424]: X-User: tempest-TestStampPattern-1846780226-project-member Apr 11 17:11:01 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:11:01 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:11:01 user devstack@n-api.service[61424]: X-User-Id: 1f7d3b94cc6b4a7d95489d7d4cf6e297 Apr 11 17:11:01 user devstack@n-api.service[61424]: X-User-Name: tempest-TestStampPattern-1846780226-project-member Apr 11 17:11:01 user devstack@n-api.service[61424]: method: > Apr 11 17:11:01 user devstack@n-api.service[61424]: exception: Instance 43b7642b-356d-4122-b006-fe7681192995 could not be found. Apr 11 17:11:01 user devstack@n-api.service[61424]: action_args: {'id': '43b7642b-356d-4122-b006-fe7681192995'} Apr 11 17:11:01 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b7642b-356d-4122-b006-fe7681192995 could not be found. Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b7642b-356d-4122-b006-fe7681192995 could not be found. Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b7642b-356d-4122-b006-fe7681192995 could not be found. Apr 11 17:11:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Returning 404 to user: Instance 43b7642b-356d-4122-b006-fe7681192995 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:11:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-47c71192-9099-4776-b172-d89e55ff9461 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995" status: 404 len: 111 microversion: 2.1 time: 0.029731 Apr 11 17:11:01 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 156/461] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:01 2023] GET /compute/v2.1/servers/43b7642b-356d-4122-b006-fe7681192995 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:11:03 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:03 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:03 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] HTTP exception thrown: Instance 9339e177-6264-4942-9dd1-372681209790 is not attached to volume 5034b953-1e89-44c6-bdba-7c70ef8124a9 Apr 11 17:11:03 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Request method failure captured: Apr 11 17:11:03 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/os-volume_attachments/5034b953-1e89-44c6-bdba-7c70ef8124a9 HTTP/1.1 Apr 11 17:11:03 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:11:03 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:11:03 user devstack@n-api.service[61422]: Connection: close Apr 11 17:11:03 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:11:03 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:11:03 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:11:03 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:11:03 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZMBMU6M01-VPqaySTM-nTESdBZmuZzIy8i9v2ExZXLaGKsY7fDPWYmrzCAdr87rW2toyMao_Hh-CEkH9W9R8ZiokkTvscNoU7ybsgcoSktG0QXe_nOgnlrM4gbgfEXqc-dc-VrzTmmN7mNxAqMFmMr2RPOErVPgKAh8DH57g0E0pGs Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Project-Id: ec4085a617084465ae810ff06498f992 Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Project-Name: tempest-TestStampPattern-1846780226 Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec4085a617084465ae810ff06498f992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec4085a617084465ae810ff06498f992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec4085a617084465ae810ff06498f992"}]}] Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Tenant: tempest-TestStampPattern-1846780226 Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Tenant-Id: ec4085a617084465ae810ff06498f992 Apr 11 17:11:03 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TestStampPattern-1846780226 Apr 11 17:11:03 user devstack@n-api.service[61422]: X-User: tempest-TestStampPattern-1846780226-project-member Apr 11 17:11:03 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:11:03 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:11:03 user devstack@n-api.service[61422]: X-User-Id: 1f7d3b94cc6b4a7d95489d7d4cf6e297 Apr 11 17:11:03 user devstack@n-api.service[61422]: X-User-Name: tempest-TestStampPattern-1846780226-project-member Apr 11 17:11:03 user devstack@n-api.service[61422]: method: > Apr 11 17:11:03 user devstack@n-api.service[61422]: exception: Instance 9339e177-6264-4942-9dd1-372681209790 is not attached to volume 5034b953-1e89-44c6-bdba-7c70ef8124a9 Apr 11 17:11:03 user devstack@n-api.service[61422]: action_args: {'server_id': '9339e177-6264-4942-9dd1-372681209790', 'id': '5034b953-1e89-44c6-bdba-7c70ef8124a9'} Apr 11 17:11:03 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5034b953-1e89-44c6-bdba-7c70ef8124a9. Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9339e177-6264-4942-9dd1-372681209790 is not attached to volume 5034b953-1e89-44c6-bdba-7c70ef8124a9 Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9339e177-6264-4942-9dd1-372681209790 is not attached to volume 5034b953-1e89-44c6-bdba-7c70ef8124a9 Apr 11 17:11:03 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:11:03 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Returning 404 to user: Instance 9339e177-6264-4942-9dd1-372681209790 is not attached to volume 5034b953-1e89-44c6-bdba-7c70ef8124a9 {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:11:03 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b5dcc4c0-1074-462a-a74b-b499558b53ee tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/os-volume_attachments/5034b953-1e89-44c6-bdba-7c70ef8124a9" status: 404 len: 154 microversion: 2.1 time: 0.089582 Apr 11 17:11:03 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 154/462] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:11:03 2023] DELETE /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790/os-volume_attachments/5034b953-1e89-44c6-bdba-7c70ef8124a9 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:11:04 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9339e177-6264-4942-9dd1-372681209790", "tag": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] Creating event network-changed:dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance 9339e177-6264-4942-9dd1-372681209790 on user Apr 11 17:11:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-9e6cac63-e5bf-4070-8ec6-f383ca877b7e req-05cbea94-7fe2-45b0-8b19-bb811e1cc6b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033870 Apr 11 17:11:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 157/463] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:11:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e49c46f1-27d1-4d2a-9268-91c8f940132f tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790" status: 204 len: 0 microversion: 2.1 time: 0.143287 Apr 11 17:11:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 153/464] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:11:04 2023] DELETE /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:11:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5b5d3ee0-f674-450e-b733-3ce33ee15959 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:04 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-5b5d3ee0-f674-450e-b733-3ce33ee15959 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5b5d3ee0-f674-450e-b733-3ce33ee15959 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5b5d3ee0-f674-450e-b733-3ce33ee15959 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5b5d3ee0-f674-450e-b733-3ce33ee15959 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5b5d3ee0-f674-450e-b733-3ce33ee15959 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5b5d3ee0-f674-450e-b733-3ce33ee15959 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5b5d3ee0-f674-450e-b733-3ce33ee15959 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:04 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-5b5d3ee0-f674-450e-b733-3ce33ee15959 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f7d3b94cc6b4a7d95489d7d4cf6e297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4085a617084465ae810ff06498f992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-5b5d3ee0-f674-450e-b733-3ce33ee15959 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790" status: 200 len: 1665 microversion: 2.1 time: 0.270233 Apr 11 17:11:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 155/465] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:04 2023] GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790 => generated 1665 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:11:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9339e177-6264-4942-9dd1-372681209790", "name": "network-vif-unplugged", "status": "completed", "tag": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] Creating event network-vif-unplugged:dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance 9339e177-6264-4942-9dd1-372681209790 on user Apr 11 17:11:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-08ffab3a-634e-40f9-89c1-ed6c6bdd4b6a req-e38add43-30dc-458b-8249-055fc26f2fab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031398 Apr 11 17:11:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 158/466] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:06 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-8ad5fbf2-ae6e-48c5-a0a5-beb50959986b req-da65d7db-2377-485a-8e5c-72684ae9de78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9339e177-6264-4942-9dd1-372681209790", "name": "network-vif-deleted", "tag": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:06 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8ad5fbf2-ae6e-48c5-a0a5-beb50959986b req-da65d7db-2377-485a-8e5c-72684ae9de78 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:06 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8ad5fbf2-ae6e-48c5-a0a5-beb50959986b req-da65d7db-2377-485a-8e5c-72684ae9de78 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:06 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8ad5fbf2-ae6e-48c5-a0a5-beb50959986b req-da65d7db-2377-485a-8e5c-72684ae9de78 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:06 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-8ad5fbf2-ae6e-48c5-a0a5-beb50959986b req-da65d7db-2377-485a-8e5c-72684ae9de78 service nova] Creating event network-vif-deleted:dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance 9339e177-6264-4942-9dd1-372681209790 on user Apr 11 17:11:06 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-8ad5fbf2-ae6e-48c5-a0a5-beb50959986b req-da65d7db-2377-485a-8e5c-72684ae9de78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031315 Apr 11 17:11:06 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 154/467] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:06 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9339e177-6264-4942-9dd1-372681209790", "name": "network-vif-plugged", "status": "completed", "tag": "dbe2ecc7-b16b-4a77-8bf7-650a08d999ce"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:06 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:06 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:06 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:06 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] Creating event network-vif-plugged:dbe2ecc7-b16b-4a77-8bf7-650a08d999ce for instance 9339e177-6264-4942-9dd1-372681209790 on user Apr 11 17:11:06 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-bb5dddd8-caae-4982-a2c1-357f4bf774c8 req-d8e2d9db-8b7b-4328-9c49-0ff8a18557eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052784 Apr 11 17:11:06 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 156/468] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:08 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:08 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] [instance: 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:08 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] HTTP exception thrown: Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e could not be found. Apr 11 17:11:08 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Request method failure captured: Apr 11 17:11:08 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e HTTP/1.1 Apr 11 17:11:08 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:11:08 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:11:08 user devstack@n-api.service[61424]: Connection: close Apr 11 17:11:08 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:11:08 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:11:08 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:11:08 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:11:08 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZK_ET0hqEvqW6Uy1clDtR0fjJTZFsxQLy4gxt0xR6qtHpO3aesoUw6ggLSsToXO-VVefZOcg0SWLVMwRoHjBCfjGzEX8eTmWW552Pko1HULZOfr1Mf85cfzzy2b7VEDZKO1OCNJuBEpzlxqeYMOyV6V2DjSQUU7wQD1r7Q_Q_q4N24 Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Project-Id: 9b803e7cf929440298b14cd3177c96e8 Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1699560884 Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9b803e7cf929440298b14cd3177c96e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9b803e7cf929440298b14cd3177c96e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9b803e7cf929440298b14cd3177c96e8"}]}] Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Tenant: tempest-ServerStableDeviceRescueTest-1699560884 Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Tenant-Id: 9b803e7cf929440298b14cd3177c96e8 Apr 11 17:11:08 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1699560884 Apr 11 17:11:08 user devstack@n-api.service[61424]: X-User: tempest-ServerStableDeviceRescueTest-1699560884-project-member Apr 11 17:11:08 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:11:08 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:11:08 user devstack@n-api.service[61424]: X-User-Id: c6126b468bd2414d831b105a3429ddd1 Apr 11 17:11:08 user devstack@n-api.service[61424]: X-User-Name: tempest-ServerStableDeviceRescueTest-1699560884-project-member Apr 11 17:11:08 user devstack@n-api.service[61424]: method: > Apr 11 17:11:08 user devstack@n-api.service[61424]: exception: Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e could not be found. Apr 11 17:11:08 user devstack@n-api.service[61424]: action_args: {'id': '17f03f63-a491-4fd4-a282-a4e9b5b6aa2e'} Apr 11 17:11:08 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e could not be found. Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e could not be found. Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e could not be found. Apr 11 17:11:08 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:08 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Returning 404 to user: Instance 17f03f63-a491-4fd4-a282-a4e9b5b6aa2e could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:11:08 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ac9d507b-3e7f-4ccc-b8e9-014c54145788 tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e" status: 404 len: 111 microversion: 2.1 time: 0.031600 Apr 11 17:11:08 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 159/469] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:08 2023] GET /compute/v2.1/servers/17f03f63-a491-4fd4-a282-a4e9b5b6aa2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:11:08 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f029dce8-5124-439a-b067-d879fe090dfa tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] Calling method '.version_select at 0x7f5bdd8d7e20>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:08 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f029dce8-5124-439a-b067-d879fe090dfa tempest-ServerStableDeviceRescueTest-1699560884 tempest-ServerStableDeviceRescueTest-1699560884-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584212675" status: 202 len: 0 microversion: 2.1 time: 0.023859 Apr 11 17:11:08 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 155/470] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 17:11:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584212675 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:11:14 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4920a0e8-178e-48ca-aa1e-79525743532d tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd836d40>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1042631262", "metadata": {"Type": "work"}}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:14 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-4920a0e8-178e-48ca-aa1e-79525743532d tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.596501 Apr 11 17:11:14 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 157/471] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 17:11:13 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 598 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 17:11:14 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-6521cb26-a12b-4d42-b8b9-b0d6d587f134 tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] Calling method '.version_select at 0x7f5bdda8dcf0>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:14 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-6521cb26-a12b-4d42-b8b9-b0d6d587f134 tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7" status: 200 len: 353 microversion: 2.1 time: 0.054373 Apr 11 17:11:14 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 160/472] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:11:14 2023] GET /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:11:14 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:14 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:14 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:11:15 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-974aa0d7-832e-415b-bf70-fa58ebc19e41 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c" status: 204 len: 0 microversion: 2.1 time: 0.124383 Apr 11 17:11:15 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 156/473] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:11:14 2023] DELETE /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:11:15 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f4562975-5033-43d5-a68f-13771854d39d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:15 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-f4562975-5033-43d5-a68f-13771854d39d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f4562975-5033-43d5-a68f-13771854d39d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f4562975-5033-43d5-a68f-13771854d39d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f4562975-5033-43d5-a68f-13771854d39d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f4562975-5033-43d5-a68f-13771854d39d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f4562975-5033-43d5-a68f-13771854d39d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f4562975-5033-43d5-a68f-13771854d39d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:15 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-f4562975-5033-43d5-a68f-13771854d39d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-f4562975-5033-43d5-a68f-13771854d39d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c" status: 200 len: 1501 microversion: 2.1 time: 0.254910 Apr 11 17:11:15 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 158/474] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:15 2023] GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c => generated 1501 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:11:15 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351fca73-83de-49b4-91d8-72e3cf45a59c", "name": "network-vif-unplugged", "status": "completed", "tag": "fe19475b-d2f0-4f2a-814c-dc6650833ff5"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:15 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=16 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:15 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:15 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:15 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:15 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=26 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:15 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] Creating event network-vif-unplugged:fe19475b-d2f0-4f2a-814c-dc6650833ff5 for instance 351fca73-83de-49b4-91d8-72e3cf45a59c on user Apr 11 17:11:15 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-ccb3ce9c-522e-42b6-be19-7d75992a9188 req-d4ccf793-4f30-4512-b879-e924c5a3ead4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036039 Apr 11 17:11:15 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 161/475] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:15 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b1f27734-d3c9-4e15-8252-39937a99406a tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] Calling method '.version_select at 0x7f5bdd858c10>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:15 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-b1f27734-d3c9-4e15-8252-39937a99406a tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7" status: 200 len: 354 microversion: 2.1 time: 0.075499 Apr 11 17:11:15 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 157/476] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:11:15 2023] GET /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7 => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:15 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-23d001cd-8ebd-407b-8681-382e9a06852a tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] Calling method '.version_select at 0x7f5bdd8349d0>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-23d001cd-8ebd-407b-8681-382e9a06852a tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7" status: 200 len: 354 microversion: 2.1 time: 0.076394 Apr 11 17:11:15 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 159/477] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:11:15 2023] GET /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7 => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:15 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-08be031d-7899-4c84-ad7f-768644ea10a9 tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] Calling method '.version_select at 0x7f5bdda8e560>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:15 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-08be031d-7899-4c84-ad7f-768644ea10a9 tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7" status: 202 len: 0 microversion: 2.1 time: 0.069704 Apr 11 17:11:15 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 162/478] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 17:11:15 2023] DELETE /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:11:15 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-c6c383b8-6f16-4f0d-8d92-4b99fafc7c51 tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] Calling method '.version_select at 0x7f5bdd859d80>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:15 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-c6c383b8-6f16-4f0d-8d92-4b99fafc7c51 tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7" status: 200 len: 353 microversion: 2.1 time: 0.053629 Apr 11 17:11:15 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 158/479] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:11:15 2023] GET /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-b8799117-f8a1-4b95-826a-04c4b35dd0f1 req-068421ec-0691-450b-bc19-727b143aca90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351fca73-83de-49b4-91d8-72e3cf45a59c", "name": "network-vif-deleted", "tag": "fe19475b-d2f0-4f2a-814c-dc6650833ff5"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b8799117-f8a1-4b95-826a-04c4b35dd0f1 req-068421ec-0691-450b-bc19-727b143aca90 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b8799117-f8a1-4b95-826a-04c4b35dd0f1 req-068421ec-0691-450b-bc19-727b143aca90 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b8799117-f8a1-4b95-826a-04c4b35dd0f1 req-068421ec-0691-450b-bc19-727b143aca90 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-b8799117-f8a1-4b95-826a-04c4b35dd0f1 req-068421ec-0691-450b-bc19-727b143aca90 service nova] Creating event network-vif-deleted:fe19475b-d2f0-4f2a-814c-dc6650833ff5 for instance 351fca73-83de-49b4-91d8-72e3cf45a59c on user Apr 11 17:11:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-b8799117-f8a1-4b95-826a-04c4b35dd0f1 req-068421ec-0691-450b-bc19-727b143aca90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035965 Apr 11 17:11:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 160/480] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-41ad4bbe-413e-41fe-b517-2108f63a0a0b tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] Calling method '.version_select at 0x7f5bdd8281f0>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-41ad4bbe-413e-41fe-b517-2108f63a0a0b tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] HTTP exception thrown: Volume 28bf702d-fade-43f0-abc6-91ce3151ead7 could not be found. Apr 11 17:11:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-41ad4bbe-413e-41fe-b517-2108f63a0a0b tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] Request method failure captured: Apr 11 17:11:16 user devstack@n-api.service[61424]: request: GET /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7 HTTP/1.1 Apr 11 17:11:16 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:11:16 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:11:16 user devstack@n-api.service[61424]: Connection: close Apr 11 17:11:16 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:11:16 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:11:16 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:11:16 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:11:16 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZSx4B8y0dHnpFyMel8aET2cjr2W5Zf2bcuftOecrHL5zWithy8eTrM8jF6BqaiXpz67gHrXw3j7fNIbKyL8vlYXpDJKyeroFxnk2Mjk9WnoBW6kagLxa5tSqBT9kQkT5p3ec0Lzda-URajtALVo7v0a3FznO6acCaUs1kgddOm9P_g Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Project-Id: e3b0bf7036204a25a99f0a60572a6fb5 Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Project-Name: tempest-VolumesGetTestJSON-30178147 Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e3b0bf7036204a25a99f0a60572a6fb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e3b0bf7036204a25a99f0a60572a6fb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e3b0bf7036204a25a99f0a60572a6fb5"}]}] Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Tenant: tempest-VolumesGetTestJSON-30178147 Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Tenant-Id: e3b0bf7036204a25a99f0a60572a6fb5 Apr 11 17:11:16 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-VolumesGetTestJSON-30178147 Apr 11 17:11:16 user devstack@n-api.service[61424]: X-User: tempest-VolumesGetTestJSON-30178147-project-member Apr 11 17:11:16 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:11:16 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:11:16 user devstack@n-api.service[61424]: X-User-Id: 42fb71044c63439385903d5decb4854c Apr 11 17:11:16 user devstack@n-api.service[61424]: X-User-Name: tempest-VolumesGetTestJSON-30178147-project-member Apr 11 17:11:16 user devstack@n-api.service[61424]: method: Apr 11 17:11:16 user devstack@n-api.service[61424]: exception: Volume 28bf702d-fade-43f0-abc6-91ce3151ead7 could not be found. Apr 11 17:11:16 user devstack@n-api.service[61424]: action_args: {'id': '28bf702d-fade-43f0-abc6-91ce3151ead7'} Apr 11 17:11:16 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 28bf702d-fade-43f0-abc6-91ce3151ead7 could not be found. (HTTP 404) (Request-ID: req-4077f654-2deb-4c87-adf6-b8ea501fe917) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 28bf702d-fade-43f0-abc6-91ce3151ead7 could not be found. Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 28bf702d-fade-43f0-abc6-91ce3151ead7 could not be found. Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 28bf702d-fade-43f0-abc6-91ce3151ead7 could not be found. Apr 11 17:11:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-41ad4bbe-413e-41fe-b517-2108f63a0a0b tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] Returning 404 to user: Volume 28bf702d-fade-43f0-abc6-91ce3151ead7 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:11:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-41ad4bbe-413e-41fe-b517-2108f63a0a0b tempest-VolumesGetTestJSON-30178147 tempest-VolumesGetTestJSON-30178147-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7" status: 404 len: 109 microversion: 2.1 time: 0.039698 Apr 11 17:11:16 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 163/481] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:11:16 2023] GET /compute/v2.1/os-volumes/28bf702d-fade-43f0-abc6-91ce3151ead7 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:11:17 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351fca73-83de-49b4-91d8-72e3cf45a59c", "name": "network-vif-plugged", "status": "completed", "tag": "fe19475b-d2f0-4f2a-814c-dc6650833ff5"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:17 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:17 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] Creating event network-vif-plugged:fe19475b-d2f0-4f2a-814c-dc6650833ff5 for instance 351fca73-83de-49b4-91d8-72e3cf45a59c on user Apr 11 17:11:17 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-b6695239-c46b-43b2-8461-9106326a01d5 req-afce55b0-ec19-4228-9bb0-1488c50c2274 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030703 Apr 11 17:11:17 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 159/482] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:19 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:19 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:19 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61422) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 17:11:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-80f4cf05-fd83-421a-9808-07d5061166e4 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca/action" status: 202 len: 0 microversion: 2.1 time: 0.115812 Apr 11 17:11:19 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 161/483] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:11:19 2023] POST /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:11:19 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-97d19d27-6797-4e02-829c-b2d3dc473bca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:19 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-97d19d27-6797-4e02-829c-b2d3dc473bca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d19d27-6797-4e02-829c-b2d3dc473bca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d19d27-6797-4e02-829c-b2d3dc473bca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d19d27-6797-4e02-829c-b2d3dc473bca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d19d27-6797-4e02-829c-b2d3dc473bca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d19d27-6797-4e02-829c-b2d3dc473bca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d19d27-6797-4e02-829c-b2d3dc473bca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:19 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-97d19d27-6797-4e02-829c-b2d3dc473bca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea404079db924f70b4a22278cee452dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2f734d27a049e7b97ba50db0db0b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:19 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-97d19d27-6797-4e02-829c-b2d3dc473bca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca" status: 200 len: 1508 microversion: 2.1 time: 0.196808 Apr 11 17:11:19 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 164/484] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:19 2023] GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:11:19 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:19 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:19 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:19 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:19 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:19 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ebaa60bf-745e-4eaf-b3ce-eb179b1b7d54 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a" status: 200 len: 1629 microversion: 2.49 time: 0.181863 Apr 11 17:11:19 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 160/485] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:11:19 2023] GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a => generated 1629 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:11:24 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-971e70af-0f9f-4cb5-a421-1b3f4c7b8e8c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:24 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-971e70af-0f9f-4cb5-a421-1b3f4c7b8e8c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-971e70af-0f9f-4cb5-a421-1b3f4c7b8e8c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-971e70af-0f9f-4cb5-a421-1b3f4c7b8e8c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-971e70af-0f9f-4cb5-a421-1b3f4c7b8e8c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-971e70af-0f9f-4cb5-a421-1b3f4c7b8e8c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-971e70af-0f9f-4cb5-a421-1b3f4c7b8e8c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-971e70af-0f9f-4cb5-a421-1b3f4c7b8e8c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:24 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-971e70af-0f9f-4cb5-a421-1b3f4c7b8e8c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878fecd141a4c0f97ead618b9cfdcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab7d4c5adc544ef9ed9f774e1e144cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:24 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-971e70af-0f9f-4cb5-a421-1b3f4c7b8e8c tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300" status: 200 len: 1495 microversion: 2.1 time: 0.169535 Apr 11 17:11:24 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 162/486] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:24 2023] GET /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300 => generated 1495 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:11:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:26 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] [instance: c689a3c0-b429-49fd-9b20-eb73353ac0b1] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] HTTP exception thrown: Instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 could not be found. Apr 11 17:11:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Request method failure captured: Apr 11 17:11:26 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/c689a3c0-b429-49fd-9b20-eb73353ac0b1 HTTP/1.1 Apr 11 17:11:26 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:11:26 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:11:26 user devstack@n-api.service[61424]: Connection: close Apr 11 17:11:26 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:11:26 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:11:26 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:11:26 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:11:26 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZQXmOtqL-ru21J42AFQPtKWxIpRqTmtsB4oF-QTMMzD6wiguIZD56aGJX3Uf0qFq5PR8wiQBDjJauu9hLXNQ_snFmLUrnQDU5hfzowDaMSu0LrIY_thO5NdH4TZlqGYwEPPaIGg6-dT-i1a2zlbtbmYviOx_HD7c91arCwYXApyKII Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Project-Id: b39994062d984774a3755b822f9a2fa7 Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Project-Name: tempest-VolumesActionsTest-316903536 Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b39994062d984774a3755b822f9a2fa7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b39994062d984774a3755b822f9a2fa7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b39994062d984774a3755b822f9a2fa7"}]}] Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Tenant: tempest-VolumesActionsTest-316903536 Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Tenant-Id: b39994062d984774a3755b822f9a2fa7 Apr 11 17:11:26 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-VolumesActionsTest-316903536 Apr 11 17:11:26 user devstack@n-api.service[61424]: X-User: tempest-VolumesActionsTest-316903536-project-member Apr 11 17:11:26 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:11:26 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:11:26 user devstack@n-api.service[61424]: X-User-Id: f637a2235ae447dc83dc4b2eb5554bff Apr 11 17:11:26 user devstack@n-api.service[61424]: X-User-Name: tempest-VolumesActionsTest-316903536-project-member Apr 11 17:11:26 user devstack@n-api.service[61424]: method: > Apr 11 17:11:26 user devstack@n-api.service[61424]: exception: Instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 could not be found. Apr 11 17:11:26 user devstack@n-api.service[61424]: action_args: {'id': 'c689a3c0-b429-49fd-9b20-eb73353ac0b1'} Apr 11 17:11:26 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 could not be found. Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 could not be found. Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 could not be found. Apr 11 17:11:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] Returning 404 to user: Instance c689a3c0-b429-49fd-9b20-eb73353ac0b1 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:11:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-69cfd661-9d30-45ed-b5b6-4694b3cb136a tempest-VolumesActionsTest-316903536 tempest-VolumesActionsTest-316903536-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c689a3c0-b429-49fd-9b20-eb73353ac0b1" status: 404 len: 111 microversion: 2.1 time: 0.034549 Apr 11 17:11:26 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 165/487] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:26 2023] GET /compute/v2.1/servers/c689a3c0-b429-49fd-9b20-eb73353ac0b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:11:26 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:26 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] Creating event network-changed:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:11:26 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-b0427b98-c18b-4d89-95b7-08d0bc62979b req-796392a9-24a7-44b0-b3f9-5b50f9da025b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038254 Apr 11 17:11:26 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 161/488] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "name": "network-vif-plugged", "status": "completed", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:29 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:29 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] Creating event network-vif-plugged:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:11:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-227de5ec-78b7-4ff6-9e8e-3aaef4a0de56 req-a5ef255a-5a5f-45d5-82d0-4a533dc0efa0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039769 Apr 11 17:11:29 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 163/489] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "name": "network-vif-plugged", "status": "completed", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] Creating event network-vif-plugged:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:11:32 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-93e6ca14-5147-4487-b40b-8d0764c55cbb req-d2a49e28-b91d-4589-b9ee-f5c76df29810 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042527 Apr 11 17:11:32 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 166/490] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-7c2acd57-3e18-401a-9be9-af8c75e104ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd8d7910>, body: {"keypair": {"name": "tempest-keypair-896312461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGkKTLlyaiNlgTA/a3+wQJKjlfUlqxOhcZof+ak5elUWRWmgYc/CbiNKCyQuPLIMAq91lRafTJCTDR90vug4Xdnzc+pbfBDvuS8gBnQ8lxmDuXBq11y3jCZxiBHnPd13g=="}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:35 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-7c2acd57-3e18-401a-9be9-af8c75e104ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting quotas for project 16e55c9209ac4b11b5af5ec1ad14d8b5. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:11:35 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-7c2acd57-3e18-401a-9be9-af8c75e104ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting quotas for user 3666d19053684843b400aab6ebf29cce and project 16e55c9209ac4b11b5af5ec1ad14d8b5. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:11:35 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-7c2acd57-3e18-401a-9be9-af8c75e104ed tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048598 Apr 11 17:11:35 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 162/491] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:11:35 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:36 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-579308500", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "13083c72-58ed-4aa4-af8c-1e9f432f7f1c"}], "security_groups": [{"name": "tempest-securitygroup--105007548"}], "key_name": "tempest-keypair-896312461", "user_data": "}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] validate_networks() for [('13083c72-58ed-4aa4-af8c-1e9f432f7f1c', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting quotas for project 16e55c9209ac4b11b5af5ec1ad14d8b5. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Getting quotas for user 3666d19053684843b400aab6ebf29cce and project 16e55c9209ac4b11b5af5ec1ad14d8b5. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:11:37 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:11:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-530a2f5b-e744-4394-804c-87fd5a7be7a3 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.672221 Apr 11 17:11:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 164/492] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:11:36 2023] POST /compute/v2.1/servers => generated 406 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:11:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-add488a7-8585-47ae-a1ec-71d270fdef6a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:37 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-add488a7-8585-47ae-a1ec-71d270fdef6a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:37 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-add488a7-8585-47ae-a1ec-71d270fdef6a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:37 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-add488a7-8585-47ae-a1ec-71d270fdef6a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" status: 200 len: 1238 microversion: 2.1 time: 0.092552 Apr 11 17:11:37 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 167/493] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:37 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:11:40 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:40 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:40 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] Creating event network-changed:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:11:40 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-b9d7a3aa-33df-4392-b602-93f9bf54efb0 req-c9fb7916-6cd3-4617-95a5-3f992f0a0f19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043863 Apr 11 17:11:40 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 163/494] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:42 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-plugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:42 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] Creating event network-vif-plugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:11:42 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-0a1ae939-45fc-49c7-9b06-03670ae0bfdc req-e0b280db-3ec4-4a14-b19b-0ea5b7a19c98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049774 Apr 11 17:11:42 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 165/495] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:44 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-plugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:44 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=11 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:44 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] Creating event network-vif-plugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:11:44 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-3705a42e-57b8-42b4-b3ca-4124c65688cf req-19560c14-1134-400f-ac49-f0bda5e2749e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041693 Apr 11 17:11:44 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 168/496] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-934361943", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "f3262209-0a5c-4763-99ae-a8319122d98c"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] validate_networks() for [('f3262209-0a5c-4763-99ae-a8319122d98c', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:11:45 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9819e319-d179-4f00-abcd-28e76916ad57 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:45 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9819e319-d179-4f00-abcd-28e76916ad57 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9819e319-d179-4f00-abcd-28e76916ad57 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9819e319-d179-4f00-abcd-28e76916ad57 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9819e319-d179-4f00-abcd-28e76916ad57 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9819e319-d179-4f00-abcd-28e76916ad57 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9819e319-d179-4f00-abcd-28e76916ad57 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9819e319-d179-4f00-abcd-28e76916ad57 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting quotas for project 361d59e2f9ac4a68a1a738cc3f2a9d14. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting quotas for user 79b5fefb1e9748b8bf51535099bf5327 and project 361d59e2f9ac4a68a1a738cc3f2a9d14. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:11:45 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:11:45 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ee45801e-b87f-439b-aa1b-9363184159dd tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.551293 Apr 11 17:11:45 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 164/497] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 17:11:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 17:11:45 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-9819e319-d179-4f00-abcd-28e76916ad57 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:45 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-bf202cc6-0337-4959-b6fa-bd732743421b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:45 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-bf202cc6-0337-4959-b6fa-bd732743421b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:45 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9819e319-d179-4f00-abcd-28e76916ad57 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 200 len: 1657 microversion: 2.1 time: 0.174650 Apr 11 17:11:45 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=14 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:45 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 166/498] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:45 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 1657 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:11:45 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-bf202cc6-0337-4959-b6fa-bd732743421b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:45 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-bf202cc6-0337-4959-b6fa-bd732743421b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:45 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-bf202cc6-0337-4959-b6fa-bd732743421b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:45 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-bf202cc6-0337-4959-b6fa-bd732743421b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a" status: 200 len: 1394 microversion: 2.87 time: 0.213107 Apr 11 17:11:45 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 169/499] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:11:45 2023] GET /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a => generated 1394 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:11:48 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87483a2-cf0e-465c-b486-361aba4c613a", "tag": "3e2ec196-65df-4e44-adfd-613978e38721"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] Creating event network-changed:3e2ec196-65df-4e44-adfd-613978e38721 for instance d87483a2-cf0e-465c-b486-361aba4c613a on user Apr 11 17:11:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-04744129-98d9-4756-95c0-7c018c75f448 req-5307fca9-01d3-4fd5-9dec-a2e3ce7b39b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032951 Apr 11 17:11:48 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 165/500] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:49 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e15fab56-bfd6-4dbc-96bd-49f03a5841b5 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:49 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e15fab56-bfd6-4dbc-96bd-49f03a5841b5 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:49 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:49 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e15fab56-bfd6-4dbc-96bd-49f03a5841b5 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e15fab56-bfd6-4dbc-96bd-49f03a5841b5 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e15fab56-bfd6-4dbc-96bd-49f03a5841b5 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e15fab56-bfd6-4dbc-96bd-49f03a5841b5 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e15fab56-bfd6-4dbc-96bd-49f03a5841b5 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e15fab56-bfd6-4dbc-96bd-49f03a5841b5 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:49 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-e15fab56-bfd6-4dbc-96bd-49f03a5841b5 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:49 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e15fab56-bfd6-4dbc-96bd-49f03a5841b5 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1676 microversion: 2.1 time: 0.169702 Apr 11 17:11:49 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 167/501] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:49 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:11:49 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1b0ed37-0ccc-4c0d-bbf5-14b56684cce4"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:49 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:49 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-659bcf4b-ca45-4801-94ef-d50a3c4b5f9c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432506 Apr 11 17:11:49 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 170/502] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:11:49 2023] POST /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments => generated 194 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:50 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87483a2-cf0e-465c-b486-361aba4c613a", "name": "network-vif-plugged", "status": "completed", "tag": "3e2ec196-65df-4e44-adfd-613978e38721"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:50 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:50 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] Creating event network-vif-plugged:3e2ec196-65df-4e44-adfd-613978e38721 for instance d87483a2-cf0e-465c-b486-361aba4c613a on user Apr 11 17:11:50 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-8a905958-10d7-4500-ba29-76e86730e14d req-730cc535-d7a0-4851-9ff1-d284d635e321 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038042 Apr 11 17:11:50 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 166/503] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:52 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87483a2-cf0e-465c-b486-361aba4c613a", "name": "network-vif-plugged", "status": "completed", "tag": "3e2ec196-65df-4e44-adfd-613978e38721"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] Creating event network-vif-plugged:3e2ec196-65df-4e44-adfd-613978e38721 for instance d87483a2-cf0e-465c-b486-361aba4c613a on user Apr 11 17:11:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-1495adb6-7320-4a21-b0e3-93b4b2d2fee4 req-9c871489-69e8-4c98-ad2f-7b85fb99cf48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033800 Apr 11 17:11:52 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 168/504] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:11:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:11:54 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:54 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] [instance: 9339e177-6264-4942-9dd1-372681209790] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:54 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] HTTP exception thrown: Instance 9339e177-6264-4942-9dd1-372681209790 could not be found. Apr 11 17:11:54 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Request method failure captured: Apr 11 17:11:54 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790 HTTP/1.1 Apr 11 17:11:54 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:11:54 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:11:54 user devstack@n-api.service[61424]: Connection: close Apr 11 17:11:54 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:11:54 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:11:54 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:11:54 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:11:54 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZMBMU6M01-VPqaySTM-nTESdBZmuZzIy8i9v2ExZXLaGKsY7fDPWYmrzCAdr87rW2toyMao_Hh-CEkH9W9R8ZiokkTvscNoU7ybsgcoSktG0QXe_nOgnlrM4gbgfEXqc-dc-VrzTmmN7mNxAqMFmMr2RPOErVPgKAh8DH57g0E0pGs Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Project-Id: ec4085a617084465ae810ff06498f992 Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Project-Name: tempest-TestStampPattern-1846780226 Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec4085a617084465ae810ff06498f992"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec4085a617084465ae810ff06498f992"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec4085a617084465ae810ff06498f992"}]}] Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Tenant: tempest-TestStampPattern-1846780226 Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Tenant-Id: ec4085a617084465ae810ff06498f992 Apr 11 17:11:54 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-TestStampPattern-1846780226 Apr 11 17:11:54 user devstack@n-api.service[61424]: X-User: tempest-TestStampPattern-1846780226-project-member Apr 11 17:11:54 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:11:54 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:11:54 user devstack@n-api.service[61424]: X-User-Id: 1f7d3b94cc6b4a7d95489d7d4cf6e297 Apr 11 17:11:54 user devstack@n-api.service[61424]: X-User-Name: tempest-TestStampPattern-1846780226-project-member Apr 11 17:11:54 user devstack@n-api.service[61424]: method: > Apr 11 17:11:54 user devstack@n-api.service[61424]: exception: Instance 9339e177-6264-4942-9dd1-372681209790 could not be found. Apr 11 17:11:54 user devstack@n-api.service[61424]: action_args: {'id': '9339e177-6264-4942-9dd1-372681209790'} Apr 11 17:11:54 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9339e177-6264-4942-9dd1-372681209790 could not be found. Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9339e177-6264-4942-9dd1-372681209790 could not be found. Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9339e177-6264-4942-9dd1-372681209790 could not be found. Apr 11 17:11:54 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:11:54 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Returning 404 to user: Instance 9339e177-6264-4942-9dd1-372681209790 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:11:54 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-767bc966-039d-40fe-a782-c39deaab57c9 tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790" status: 404 len: 111 microversion: 2.1 time: 0.042444 Apr 11 17:11:54 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 171/505] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:54 2023] GET /compute/v2.1/servers/9339e177-6264-4942-9dd1-372681209790 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:11:57 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:57 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:57 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-354cf1f9-efb7-4684-90fc-0656bd20544a tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] Calling method '.version_select at 0x7f5bdd73e200>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:57 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-354cf1f9-efb7-4684-90fc-0656bd20544a tempest-TestStampPattern-1846780226 tempest-TestStampPattern-1846780226-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1509466846" status: 202 len: 0 microversion: 2.1 time: 0.040278 Apr 11 17:11:57 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 167/506] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 17:11:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1509466846 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Old instance type m1.nano, new instance type m1.micro {{(pid=61422) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for project db242f5f39d94966948e8b487cd52d0c. Resources: {'cores', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for user 8f4ba7d7f3f74b5c800be2408c1035e2 and project db242f5f39d94966948e8b487cd52d0c. Resources: {'cores', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:11:57 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:11:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9e605c7b-7398-4826-97de-cf8adc18bac3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/action" status: 202 len: 0 microversion: 2.1 time: 0.309065 Apr 11 17:11:57 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 169/507] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:11:57 2023] POST /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:11:57 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f361f8fe-d574-4b8b-a8aa-bb71efa785e2 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:11:57 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f361f8fe-d574-4b8b-a8aa-bb71efa785e2 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:11:57 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=4 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:11:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f361f8fe-d574-4b8b-a8aa-bb71efa785e2 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f361f8fe-d574-4b8b-a8aa-bb71efa785e2 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f361f8fe-d574-4b8b-a8aa-bb71efa785e2 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f361f8fe-d574-4b8b-a8aa-bb71efa785e2 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:11:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f361f8fe-d574-4b8b-a8aa-bb71efa785e2 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:11:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f361f8fe-d574-4b8b-a8aa-bb71efa785e2 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:11:57 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-f361f8fe-d574-4b8b-a8aa-bb71efa785e2 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:11:57 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f361f8fe-d574-4b8b-a8aa-bb71efa785e2 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1731 microversion: 2.1 time: 0.181629 Apr 11 17:11:57 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 172/508] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:11:57 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:12:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-unplugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] Creating event network-vif-unplugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:12:00 user devstack@n-api.service[61423]: DEBUG nova.compute.api [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61423) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:12:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-1da2a96c-c112-4b16-ba7e-9203f44dd5a8 req-1d9688c3-5db5-482e-8fb4-3918feb31ff6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052960 Apr 11 17:12:00 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 168/509] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:12:02 user devstack@n-api.service[61422]: DEBUG nova.compute.api [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61422) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:12:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-b1386aca-c53d-43b9-b7a8-8aaf6ec6537b req-fa92ca1d-9fda-4d58-847e-7cc6f2b2fa94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047119 Apr 11 17:12:02 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 170/510] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:05 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:05 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:05 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] HTTP exception thrown: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:12:05 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Request method failure captured: Apr 11 17:12:05 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c HTTP/1.1 Apr 11 17:12:05 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:12:05 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:12:05 user devstack@n-api.service[61424]: Connection: close Apr 11 17:12:05 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:12:05 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:12:05 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:12:05 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:12:05 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZPU2p5bCkmg0x_Q9dIkdqgqytm9uHgC0um1qHTWCne6uVxRI3BdOhhPkg5QR_fOQQ9oexwVC4ZHJDY8YKipla0AMDPwiudTG5ukXQAAeFNYD8oeBChIFNMN8C-svM_Bzq767kTUfH6aX8e1gtuLuIafyXlkukj6atCYDbKZV2bsmck Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Project-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Project-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}] Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Tenant: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Tenant-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:12:05 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:12:05 user devstack@n-api.service[61424]: X-User: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:12:05 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:12:05 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:12:05 user devstack@n-api.service[61424]: X-User-Id: d0c53186c18940aba415e0b999cbc2a0 Apr 11 17:12:05 user devstack@n-api.service[61424]: X-User-Name: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:12:05 user devstack@n-api.service[61424]: method: > Apr 11 17:12:05 user devstack@n-api.service[61424]: exception: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:12:05 user devstack@n-api.service[61424]: action_args: {'id': '351fca73-83de-49b4-91d8-72e3cf45a59c'} Apr 11 17:12:05 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:12:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:12:05 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Returning 404 to user: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:12:05 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-bc6edbb1-280f-4d5f-af74-94dec361713a tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c" status: 404 len: 111 microversion: 2.1 time: 0.032242 Apr 11 17:12:05 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 173/511] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:12:05 2023] GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:12:05 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ae34a664-8cc6-47e8-8731-3e8e0bac28fc tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:05 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ae34a664-8cc6-47e8-8731-3e8e0bac28fc tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae34a664-8cc6-47e8-8731-3e8e0bac28fc tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae34a664-8cc6-47e8-8731-3e8e0bac28fc tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae34a664-8cc6-47e8-8731-3e8e0bac28fc tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae34a664-8cc6-47e8-8731-3e8e0bac28fc tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae34a664-8cc6-47e8-8731-3e8e0bac28fc tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae34a664-8cc6-47e8-8731-3e8e0bac28fc tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:05 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ae34a664-8cc6-47e8-8731-3e8e0bac28fc tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:05 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ae34a664-8cc6-47e8-8731-3e8e0bac28fc tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705" status: 200 len: 1493 microversion: 2.1 time: 0.187576 Apr 11 17:12:05 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 169/512] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:12:05 2023] GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705 => generated 1493 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3df8f455-ee21-46e2-ae30-8e24d133ca77 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-3df8f455-ee21-46e2-ae30-8e24d133ca77 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3df8f455-ee21-46e2-ae30-8e24d133ca77 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3df8f455-ee21-46e2-ae30-8e24d133ca77 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3df8f455-ee21-46e2-ae30-8e24d133ca77 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3df8f455-ee21-46e2-ae30-8e24d133ca77 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3df8f455-ee21-46e2-ae30-8e24d133ca77 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3df8f455-ee21-46e2-ae30-8e24d133ca77 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:09 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-3df8f455-ee21-46e2-ae30-8e24d133ca77 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea404079db924f70b4a22278cee452dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2f734d27a049e7b97ba50db0db0b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3df8f455-ee21-46e2-ae30-8e24d133ca77 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca" status: 200 len: 1553 microversion: 2.1 time: 0.288123 Apr 11 17:12:09 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 171/513] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:12:09 2023] GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca => generated 1553 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:12:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:12:12 user devstack@n-api.service[61424]: DEBUG nova.compute.api [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61424) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:12:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-d5e4d241-b7d1-458d-a0c3-afb1c4cd401f req-0ca91d9a-b765-4cf2-82f3-cc5dfb2a27ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059258 Apr 11 17:12:12 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 174/514] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:14 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:14 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=19 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:14 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:12:14 user devstack@n-api.service[61423]: DEBUG nova.compute.api [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61423) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:12:14 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-7851c15f-fabb-488c-a24b-8d46651b6240 req-0d9f6884-6f6e-406c-a85b-902631ffa9ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043493 Apr 11 17:12:14 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 170/515] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:19 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ada857ff-2527-46c6-beb4-be014712414c tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:19 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ada857ff-2527-46c6-beb4-be014712414c tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:19 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ada857ff-2527-46c6-beb4-be014712414c tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ada857ff-2527-46c6-beb4-be014712414c tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ada857ff-2527-46c6-beb4-be014712414c tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ada857ff-2527-46c6-beb4-be014712414c tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ada857ff-2527-46c6-beb4-be014712414c tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ada857ff-2527-46c6-beb4-be014712414c tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:19 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=5 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ada857ff-2527-46c6-beb4-be014712414c tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.109892 Apr 11 17:12:19 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 172/516] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 17:12:19 2023] GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-interface => generated 283 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:12:20 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "tag": "d5605470-2058-46dd-bc30-a8f0ba8c82db"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:20 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=16 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:20 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:20 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] Creating event network-changed:d5605470-2058-46dd-bc30-a8f0ba8c82db for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:12:20 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-334b2ce8-4dbb-43fe-ad5e-e2c8cb821036 req-09577cfa-daad-40d6-b15a-bebf6a1096bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054998 Apr 11 17:12:20 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 175/517] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:20 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:20 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:20 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:20 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:20 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-47f8f17e-3990-4f77-b7d2-68619015f49a tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a" status: 200 len: 1629 microversion: 2.49 time: 0.299282 Apr 11 17:12:20 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 171/518] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:12:20 2023] GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a => generated 1629 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:12:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "5485eb75-ad94-4060-9bd6-b8c22408ce41", "tag": "nic-tag"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:21 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:23 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "tag": "e6963b86-72cc-4034-866e-6c009d0af81f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:23 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] Creating event network-changed:e6963b86-72cc-4034-866e-6c009d0af81f for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:12:23 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-d95e7d86-3373-41e2-8bf5-cc5d2ef7b32a req-ac33555f-ed4b-4aa3-bdcd-04f0efc81d68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044602 Apr 11 17:12:23 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 176/519] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1735547101", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "c8b61c1c-b4db-489e-89d8-80ebbf708f7e", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] validate_networks() for [('dd04c0b8-1ba3-450d-9eab-fd88096ba41e', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for user c7dcfe84c23f4c0aa80b8f287f0ab004 and project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:12:23 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c8b61c1c-b4db-489e-89d8-80ebbf708f7e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:12:23 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e0bf75f9-3fc2-47e1-9453-5ba3ee50d062 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.614213 Apr 11 17:12:23 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 172/520] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:12:23 2023] POST /compute/v2.1/servers => generated 378 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:12:23 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-abbba61b-5b92-4cdf-9e0a-a242879370c6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:23 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-abbba61b-5b92-4cdf-9e0a-a242879370c6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:24 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-abbba61b-5b92-4cdf-9e0a-a242879370c6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:24 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-abbba61b-5b92-4cdf-9e0a-a242879370c6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33" status: 200 len: 1052 microversion: 2.1 time: 0.080096 Apr 11 17:12:24 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 177/521] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:12:23 2023] GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 => generated 1052 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:12:24 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-plugged", "status": "completed", "tag": "e6963b86-72cc-4034-866e-6c009d0af81f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:24 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:24 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:24 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:24 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] Creating event network-vif-plugged:e6963b86-72cc-4034-866e-6c009d0af81f for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:12:24 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-b3dd07e9-7424-46f6-bc3f-6e398da90c21 req-215c2769-89d7-44dc-a6bd-bb41ece2166b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 Apr 11 17:12:24 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 173/522] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:24 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0797f963-a3b2-4066-969d-a9be1a6c4c73", "device": "/dev/vdb"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:24 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:24 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-1ef31fd8-6883-4476-b1e9-c57215d2fbae tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-interface" status: 200 len: 282 microversion: 2.49 time: 3.990265 Apr 11 17:12:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 173/523] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Apr 11 17:12:21 2023] POST /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-interface => generated 282 bytes in 3991 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:12:25 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9", "tag": "volume-tag"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:25 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:25 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-2cb238d6-5a93-4b1d-aaf3-b6a88f3729ec tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343499 Apr 11 17:12:25 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 178/524] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:12:24 2023] POST /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:25 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-fdc73294-2580-4579-8e9c-c4de0c90e5b3 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.330458 Apr 11 17:12:25 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 174/525] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 17:12:25 2023] POST /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:12:26 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-plugged", "status": "completed", "tag": "e6963b86-72cc-4034-866e-6c009d0af81f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] Creating event network-vif-plugged:e6963b86-72cc-4034-866e-6c009d0af81f for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:12:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-33c03711-7f45-4472-9807-adf3a751685e req-0f4e2d9a-3c4b-40a2-a74a-da0566d0f4ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031043 Apr 11 17:12:26 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 174/526] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:27 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821c0f5c-2011-443d-9455-49cc9e317e33", "tag": "5ed86986-3eff-4f85-83ed-3db9257c5ec9"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] Creating event network-changed:5ed86986-3eff-4f85-83ed-3db9257c5ec9 for instance 821c0f5c-2011-443d-9455-49cc9e317e33 on user Apr 11 17:12:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-a2ea13c1-2268-4ca7-9b41-ee2237722b25 req-9fdf7fee-efd0-480c-bad5-0273756f5b11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038190 Apr 11 17:12:27 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 179/527] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:27 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f2ecf2d2-8d8a-4d86-85e9-a17cb4071883 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:27 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-f2ecf2d2-8d8a-4d86-85e9-a17cb4071883 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f2ecf2d2-8d8a-4d86-85e9-a17cb4071883 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f2ecf2d2-8d8a-4d86-85e9-a17cb4071883 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f2ecf2d2-8d8a-4d86-85e9-a17cb4071883 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f2ecf2d2-8d8a-4d86-85e9-a17cb4071883 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f2ecf2d2-8d8a-4d86-85e9-a17cb4071883 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f2ecf2d2-8d8a-4d86-85e9-a17cb4071883 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:27 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-f2ecf2d2-8d8a-4d86-85e9-a17cb4071883 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:27 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f2ecf2d2-8d8a-4d86-85e9-a17cb4071883 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" status: 200 len: 1551 microversion: 2.1 time: 0.160532 Apr 11 17:12:27 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 175/528] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:12:27 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:12:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:33 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:33 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lazy-loading 'services' on Instance uuid 9efebdaa-288e-42f5-af7d-ca64963be57a {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:12:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-2e4c2910-d903-4988-aa7b-5bc2f96443fe tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-volume_attachments/fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9" status: 202 len: 0 microversion: 2.49 time: 0.214907 Apr 11 17:12:33 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 175/529] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 17:12:33 2023] DELETE /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-volume_attachments/fcf4e59b-3693-4c07-9b0b-5e4fdbdc1ce9 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:36 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:36 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-1f79cee3-e292-4968-9304-a6997862d5b9 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a" status: 200 len: 1691 microversion: 2.87 time: 0.198115 Apr 11 17:12:36 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 180/530] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:12:36 2023] GET /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:12:36 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:36 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:36 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:36 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:36 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-interface/e6963b86-72cc-4034-866e-6c009d0af81f" status: 202 len: 0 microversion: 2.49 time: 0.058670 Apr 11 17:12:36 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 176/531] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Apr 11 17:12:36 2023] DELETE /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-interface/e6963b86-72cc-4034-866e-6c009d0af81f => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-982c7628-690f-40bd-add3-af872e3aae27 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-982c7628-690f-40bd-add3-af872e3aae27 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-982c7628-690f-40bd-add3-af872e3aae27 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-982c7628-690f-40bd-add3-af872e3aae27 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-982c7628-690f-40bd-add3-af872e3aae27 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-982c7628-690f-40bd-add3-af872e3aae27 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-982c7628-690f-40bd-add3-af872e3aae27 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-982c7628-690f-40bd-add3-af872e3aae27 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-982c7628-690f-40bd-add3-af872e3aae27 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-instance-actions/req-4986efcb-765d-44b9-b2bc-70dc64f2aa14" status: 200 len: 474 microversion: 2.49 time: 0.299407 Apr 11 17:12:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 176/532] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 17:12:36 2023] GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-instance-actions/req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 => generated 474 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-unplugged", "status": "completed", "tag": "e6963b86-72cc-4034-866e-6c009d0af81f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:37 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] Creating event network-vif-unplugged:e6963b86-72cc-4034-866e-6c009d0af81f for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:12:37 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-9836ce73-553e-4e03-9c64-d13ad7eb2a43 req-5c62e804-52d6-4bcd-bab0-380a580a6d50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113972 Apr 11 17:12:37 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 181/533] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:37 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-deleted", "tag": "e6963b86-72cc-4034-866e-6c009d0af81f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] Creating event network-vif-deleted:e6963b86-72cc-4034-866e-6c009d0af81f for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:12:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-120d1068-0355-4e30-8192-364eed7372a0 req-a5407ffa-8ce6-431d-b405-dec15a3fab9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032171 Apr 11 17:12:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 177/534] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:37 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lazy-loading 'services' on Instance uuid 5132062e-f602-4568-83ed-bc6fa2890300 {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:12:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-592b7528-e8af-47af-904c-b043686134df tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300/os-volume_attachments/0797f963-a3b2-4066-969d-a9be1a6c4c73" status: 202 len: 0 microversion: 2.1 time: 0.175065 Apr 11 17:12:37 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 177/535] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:12:37 2023] DELETE /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300/os-volume_attachments/0797f963-a3b2-4066-969d-a9be1a6c4c73 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:38 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:12:38 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-7a3c279b-a1e8-4897-9460-7bdb3915231a tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300" status: 204 len: 0 microversion: 2.1 time: 0.142049 Apr 11 17:12:38 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 182/536] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:12:37 2023] DELETE /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:12:38 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-542e8941-cab6-4787-8f41-1119de08e75e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:38 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-542e8941-cab6-4787-8f41-1119de08e75e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-542e8941-cab6-4787-8f41-1119de08e75e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-542e8941-cab6-4787-8f41-1119de08e75e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-542e8941-cab6-4787-8f41-1119de08e75e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-542e8941-cab6-4787-8f41-1119de08e75e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-542e8941-cab6-4787-8f41-1119de08e75e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-542e8941-cab6-4787-8f41-1119de08e75e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:38 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-542e8941-cab6-4787-8f41-1119de08e75e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878fecd141a4c0f97ead618b9cfdcbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ab7d4c5adc544ef9ed9f774e1e144cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-542e8941-cab6-4787-8f41-1119de08e75e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300" status: 200 len: 1547 microversion: 2.1 time: 0.236170 Apr 11 17:12:38 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 178/537] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:12:38 2023] GET /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300 => generated 1547 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:12:39 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-plugged", "status": "completed", "tag": "e6963b86-72cc-4034-866e-6c009d0af81f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:39 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] Creating event network-vif-plugged:e6963b86-72cc-4034-866e-6c009d0af81f for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:12:39 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-450b39b9-9fe4-4780-b8b4-8cc07fa25d57 req-8855970d-3bfe-4354-a036-0755b428ddde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030310 Apr 11 17:12:39 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 178/538] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:39 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821c0f5c-2011-443d-9455-49cc9e317e33", "name": "network-vif-plugged", "status": "completed", "tag": "5ed86986-3eff-4f85-83ed-3db9257c5ec9"}, {"server_uuid": "821c0f5c-2011-443d-9455-49cc9e317e33", "name": "network-vif-plugged", "status": "completed", "tag": "5ed86986-3eff-4f85-83ed-3db9257c5ec9"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Creating event network-vif-plugged:5ed86986-3eff-4f85-83ed-3db9257c5ec9 for instance 821c0f5c-2011-443d-9455-49cc9e317e33 on user Apr 11 17:12:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] Creating event network-vif-plugged:5ed86986-3eff-4f85-83ed-3db9257c5ec9 for instance 821c0f5c-2011-443d-9455-49cc9e317e33 on user Apr 11 17:12:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-2a0f8a07-31d3-471d-b1d2-eb6e679dc99a req-4579e59a-fd15-41d6-b799-d014b4d0b980 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043173 Apr 11 17:12:39 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 183/539] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5132062e-f602-4568-83ed-bc6fa2890300", "name": "network-vif-unplugged", "status": "completed", "tag": "3cb911aa-7791-4ad0-af48-0e70fcd29e68"}, {"server_uuid": "5132062e-f602-4568-83ed-bc6fa2890300", "name": "network-vif-plugged", "status": "completed", "tag": "3cb911aa-7791-4ad0-af48-0e70fcd29e68"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Creating event network-vif-unplugged:3cb911aa-7791-4ad0-af48-0e70fcd29e68 for instance 5132062e-f602-4568-83ed-bc6fa2890300 on user Apr 11 17:12:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] Creating event network-vif-plugged:3cb911aa-7791-4ad0-af48-0e70fcd29e68 for instance 5132062e-f602-4568-83ed-bc6fa2890300 on user Apr 11 17:12:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-8925c77d-279a-42f3-b165-29c3dbe16862 req-fb5c8587-74e7-4dde-b856-9a0e94d5abb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028149 Apr 11 17:12:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 179/540] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:41 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-4f56e9a2-79ce-493a-9e05-d852a7696023 req-c98e9d02-557f-41dd-8225-158c5910a2b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5132062e-f602-4568-83ed-bc6fa2890300", "name": "network-vif-deleted", "tag": "3cb911aa-7791-4ad0-af48-0e70fcd29e68"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4f56e9a2-79ce-493a-9e05-d852a7696023 req-c98e9d02-557f-41dd-8225-158c5910a2b4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4f56e9a2-79ce-493a-9e05-d852a7696023 req-c98e9d02-557f-41dd-8225-158c5910a2b4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4f56e9a2-79ce-493a-9e05-d852a7696023 req-c98e9d02-557f-41dd-8225-158c5910a2b4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-4f56e9a2-79ce-493a-9e05-d852a7696023 req-c98e9d02-557f-41dd-8225-158c5910a2b4 service nova] Creating event network-vif-deleted:3cb911aa-7791-4ad0-af48-0e70fcd29e68 for instance 5132062e-f602-4568-83ed-bc6fa2890300 on user Apr 11 17:12:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-4f56e9a2-79ce-493a-9e05-d852a7696023 req-c98e9d02-557f-41dd-8225-158c5910a2b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032721 Apr 11 17:12:41 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 179/541] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:45 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-a31740b4-9d41-4388-9227-bd41ba0defbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:45 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-a31740b4-9d41-4388-9227-bd41ba0defbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a31740b4-9d41-4388-9227-bd41ba0defbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a31740b4-9d41-4388-9227-bd41ba0defbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a31740b4-9d41-4388-9227-bd41ba0defbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a31740b4-9d41-4388-9227-bd41ba0defbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a31740b4-9d41-4388-9227-bd41ba0defbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a31740b4-9d41-4388-9227-bd41ba0defbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:46 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-a31740b4-9d41-4388-9227-bd41ba0defbb tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050011 Apr 11 17:12:46 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 184/542] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:12:45 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:12:46 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:46 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:46 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:12:46 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ef3ecf48-14ac-4bc7-bb3c-39bc95fc3d26 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 204 len: 0 microversion: 2.1 time: 0.126377 Apr 11 17:12:46 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 180/543] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:12:46 2023] DELETE /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:12:46 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-d64c5221-46df-418a-8a6e-34eb43fb7da3 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:46 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-d64c5221-46df-418a-8a6e-34eb43fb7da3 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d64c5221-46df-418a-8a6e-34eb43fb7da3 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d64c5221-46df-418a-8a6e-34eb43fb7da3 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d64c5221-46df-418a-8a6e-34eb43fb7da3 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d64c5221-46df-418a-8a6e-34eb43fb7da3 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d64c5221-46df-418a-8a6e-34eb43fb7da3 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d64c5221-46df-418a-8a6e-34eb43fb7da3 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:46 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:12:46 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-d64c5221-46df-418a-8a6e-34eb43fb7da3 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:46 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-d64c5221-46df-418a-8a6e-34eb43fb7da3 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 200 len: 1663 microversion: 2.1 time: 0.203525 Apr 11 17:12:46 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 180/544] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:12:46 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 1663 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:12:46 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-unplugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:46 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] Creating event network-vif-unplugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:12:46 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-80c46cea-4f93-46bf-8f7a-a2463e8d8e3b req-bc8f784f-4674-403e-b1f8-b368c8e151ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047086 Apr 11 17:12:46 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 185/545] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:12:48 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-89af3095-71bb-4c0d-bc25-c743eed10deb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:12:48 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-89af3095-71bb-4c0d-bc25-c743eed10deb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:12:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89af3095-71bb-4c0d-bc25-c743eed10deb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89af3095-71bb-4c0d-bc25-c743eed10deb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89af3095-71bb-4c0d-bc25-c743eed10deb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89af3095-71bb-4c0d-bc25-c743eed10deb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89af3095-71bb-4c0d-bc25-c743eed10deb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89af3095-71bb-4c0d-bc25-c743eed10deb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:48 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-89af3095-71bb-4c0d-bc25-c743eed10deb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:12:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-89af3095-71bb-4c0d-bc25-c743eed10deb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1730 microversion: 2.1 time: 0.185568 Apr 11 17:12:48 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 181/546] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:12:48 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:12:48 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-plugged", "status": "completed", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}, {"server_uuid": "d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32", "name": "network-vif-deleted", "tag": "8b4b45a7-1e14-4c93-a6a9-fe814512cef2"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:12:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:12:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:12:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:12:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] Creating event network-vif-plugged:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:12:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] Creating event network-vif-deleted:8b4b45a7-1e14-4c93-a6a9-fe814512cef2 for instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 on user Apr 11 17:12:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-f86037b9-3947-4550-96bf-cc4586798161 req-c79555ca-ed0a-466c-bd56-40bf96be9974 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036067 Apr 11 17:12:48 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 181/547] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:12:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:07 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-809579c5-9705-48bf-9d61-323116479442 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1001515803", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "2c1b37a5-77bd-4914-9b27-f6c83186183f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "fc5f2351-9e4e-4481-9745-87fe310d86e2"}]}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:07 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:07 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-809579c5-9705-48bf-9d61-323116479442 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] HTTP exception thrown: Block Device 2c1b37a5-77bd-4914-9b27-f6c83186183f is not bootable. Apr 11 17:13:07 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-809579c5-9705-48bf-9d61-323116479442 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Request method failure captured: Apr 11 17:13:07 user devstack@n-api.service[61424]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 17:13:07 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:13:07 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:13:07 user devstack@n-api.service[61424]: Connection: close Apr 11 17:13:07 user devstack@n-api.service[61424]: Content-Length: 357 Apr 11 17:13:07 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:13:07 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:13:07 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:13:07 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZPU2p5bCkmg0x_Q9dIkdqgqytm9uHgC0um1qHTWCne6uVxRI3BdOhhPkg5QR_fOQQ9oexwVC4ZHJDY8YKipla0AMDPwiudTG5ukXQAAeFNYD8oeBChIFNMN8C-svM_Bzq767kTUfH6aX8e1gtuLuIafyXlkukj6atCYDbKZV2bsmck Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Project-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Project-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}] Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Tenant: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Tenant-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:13:07 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:13:07 user devstack@n-api.service[61424]: X-User: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:13:07 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:13:07 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:13:07 user devstack@n-api.service[61424]: X-User-Id: d0c53186c18940aba415e0b999cbc2a0 Apr 11 17:13:07 user devstack@n-api.service[61424]: X-User-Name: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:13:07 user devstack@n-api.service[61424]: Apr 11 17:13:07 user devstack@n-api.service[61424]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1001515803", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "2c1b37a5-77bd-4914-9b27-f6c83186183f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "fc5f2351-9e4e-4481-9745-87fe310d86e2"}]}} Apr 11 17:13:07 user devstack@n-api.service[61424]: method: > Apr 11 17:13:07 user devstack@n-api.service[61424]: exception: Block Device 2c1b37a5-77bd-4914-9b27-f6c83186183f is not bootable. Apr 11 17:13:07 user devstack@n-api.service[61424]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1001515803', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '2c1b37a5-77bd-4914-9b27-f6c83186183f'}], 'networks': [{'uuid': 'fc5f2351-9e4e-4481-9745-87fe310d86e2'}]}}} Apr 11 17:13:07 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 2c1b37a5-77bd-4914-9b27-f6c83186183f is not bootable. Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 2c1b37a5-77bd-4914-9b27-f6c83186183f is not bootable. Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 2c1b37a5-77bd-4914-9b27-f6c83186183f is not bootable. Apr 11 17:13:07 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:13:07 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-809579c5-9705-48bf-9d61-323116479442 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Returning 400 to user: Block Device 2c1b37a5-77bd-4914-9b27-f6c83186183f is not bootable. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:13:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-809579c5-9705-48bf-9d61-323116479442 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.180024 Apr 11 17:13:07 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 186/548] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:13:07 2023] POST /compute/v2.1/servers => generated 110 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:13:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-356de720-6735-45a0-92f3-d12b8619970c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:07 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-356de720-6735-45a0-92f3-d12b8619970c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:07 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:07 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-356de720-6735-45a0-92f3-d12b8619970c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-356de720-6735-45a0-92f3-d12b8619970c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-356de720-6735-45a0-92f3-d12b8619970c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-356de720-6735-45a0-92f3-d12b8619970c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-356de720-6735-45a0-92f3-d12b8619970c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-356de720-6735-45a0-92f3-d12b8619970c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:07 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-356de720-6735-45a0-92f3-d12b8619970c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-356de720-6735-45a0-92f3-d12b8619970c tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705" status: 200 len: 1493 microversion: 2.1 time: 0.316077 Apr 11 17:13:07 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 182/549] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:13:07 2023] GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705 => generated 1493 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:13:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=7 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:10 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] Creating event network-changed:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:13:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-30e28a81-3054-4d7c-b479-ff0d5d1ac0e1 req-f4642e5a-9f9c-4c18-ae06-c11eb52dceb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033167 Apr 11 17:13:10 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 187/550] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:13:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-bd158c42-76e0-410b-835c-9191b4c93bf9 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca" status: 204 len: 0 microversion: 2.1 time: 0.128514 Apr 11 17:13:10 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 182/551] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:13:10 2023] DELETE /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 17:13:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-190680ae-e2ee-4f11-b699-28ea9aafb05a tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:10 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-190680ae-e2ee-4f11-b699-28ea9aafb05a tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-190680ae-e2ee-4f11-b699-28ea9aafb05a tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-190680ae-e2ee-4f11-b699-28ea9aafb05a tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-190680ae-e2ee-4f11-b699-28ea9aafb05a tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-190680ae-e2ee-4f11-b699-28ea9aafb05a tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-190680ae-e2ee-4f11-b699-28ea9aafb05a tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-190680ae-e2ee-4f11-b699-28ea9aafb05a tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:11 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-190680ae-e2ee-4f11-b699-28ea9aafb05a tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea404079db924f70b4a22278cee452dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf2f734d27a049e7b97ba50db0db0b6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-190680ae-e2ee-4f11-b699-28ea9aafb05a tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca" status: 200 len: 1559 microversion: 2.1 time: 0.232172 Apr 11 17:13:11 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 183/552] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:13:10 2023] GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:13:11 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "name": "network-vif-unplugged", "status": "completed", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] Creating event network-vif-unplugged:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:13:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-d35ea92a-4989-4f90-b35d-3ee61a69afc1 req-62f29bc4-a447-43b5-bd73-16e2800f7078 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036158 Apr 11 17:13:11 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 188/553] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:12 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-23649a51-ce96-427e-9be6-87e9dc721d8b req-787395b9-718d-44e4-94c0-c5c24f40f560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "name": "network-vif-deleted", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-23649a51-ce96-427e-9be6-87e9dc721d8b req-787395b9-718d-44e4-94c0-c5c24f40f560 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-23649a51-ce96-427e-9be6-87e9dc721d8b req-787395b9-718d-44e4-94c0-c5c24f40f560 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-23649a51-ce96-427e-9be6-87e9dc721d8b req-787395b9-718d-44e4-94c0-c5c24f40f560 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:12 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-23649a51-ce96-427e-9be6-87e9dc721d8b req-787395b9-718d-44e4-94c0-c5c24f40f560 service nova] Creating event network-vif-deleted:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:13:12 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-23649a51-ce96-427e-9be6-87e9dc721d8b req-787395b9-718d-44e4-94c0-c5c24f40f560 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032414 Apr 11 17:13:12 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 183/554] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dba29188-c963-44d4-95fa-09bffbcb8dca", "name": "network-vif-plugged", "status": "completed", "tag": "fe9d8f85-8c07-4fef-ac72-417df1310bd3"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] Creating event network-vif-plugged:fe9d8f85-8c07-4fef-ac72-417df1310bd3 for instance dba29188-c963-44d4-95fa-09bffbcb8dca on user Apr 11 17:13:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-c7cfa743-3621-43f5-9366-5bcde91607f8 req-d660711e-f7ff-4702-88ad-641d13e68023 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036265 Apr 11 17:13:13 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 184/555] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:14 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-7ac0354b-dd8f-4800-b982-2fb0dab75f8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:14 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-7ac0354b-dd8f-4800-b982-2fb0dab75f8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7ac0354b-dd8f-4800-b982-2fb0dab75f8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7ac0354b-dd8f-4800-b982-2fb0dab75f8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7ac0354b-dd8f-4800-b982-2fb0dab75f8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7ac0354b-dd8f-4800-b982-2fb0dab75f8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7ac0354b-dd8f-4800-b982-2fb0dab75f8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7ac0354b-dd8f-4800-b982-2fb0dab75f8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:14 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-7ac0354b-dd8f-4800-b982-2fb0dab75f8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:14 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-7ac0354b-dd8f-4800-b982-2fb0dab75f8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33" status: 200 len: 1378 microversion: 2.1 time: 0.154419 Apr 11 17:13:14 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 189/556] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:13:14 2023] GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 => generated 1378 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-d58dd4e9-b551-40e5-9157-844bfbd0df22 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-d58dd4e9-b551-40e5-9157-844bfbd0df22 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d58dd4e9-b551-40e5-9157-844bfbd0df22 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d58dd4e9-b551-40e5-9157-844bfbd0df22 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d58dd4e9-b551-40e5-9157-844bfbd0df22 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d58dd4e9-b551-40e5-9157-844bfbd0df22 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d58dd4e9-b551-40e5-9157-844bfbd0df22 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d58dd4e9-b551-40e5-9157-844bfbd0df22 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:27 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-d58dd4e9-b551-40e5-9157-844bfbd0df22 tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-instance-actions/req-4986efcb-765d-44b9-b2bc-70dc64f2aa14" status: 200 len: 503 microversion: 2.49 time: 0.090021 Apr 11 17:13:27 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 184/557] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 17:13:27 2023] GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-instance-actions/req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 => generated 503 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-382ff88c-b0e0-410b-84dd-1c3b4b02c35b tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-382ff88c-b0e0-410b-84dd-1c3b4b02c35b tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=14 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-382ff88c-b0e0-410b-84dd-1c3b4b02c35b tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-382ff88c-b0e0-410b-84dd-1c3b4b02c35b tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-382ff88c-b0e0-410b-84dd-1c3b4b02c35b tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-382ff88c-b0e0-410b-84dd-1c3b4b02c35b tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-382ff88c-b0e0-410b-84dd-1c3b4b02c35b tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-382ff88c-b0e0-410b-84dd-1c3b4b02c35b tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:27 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-382ff88c-b0e0-410b-84dd-1c3b4b02c35b tempest-TaggedAttachmentsTest-416423034 tempest-TaggedAttachmentsTest-416423034-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-instance-actions/req-4986efcb-765d-44b9-b2bc-70dc64f2aa14" status: 200 len: 503 microversion: 2.49 time: 0.056092 Apr 11 17:13:27 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 185/558] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 17:13:27 2023] GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-instance-actions/req-4986efcb-765d-44b9-b2bc-70dc64f2aa14 => generated 503 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:13:27 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-70e64da7-1def-4894-a268-3feb81d913a9 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:27 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-70e64da7-1def-4894-a268-3feb81d913a9 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:27 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=8 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:27 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=10 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-70e64da7-1def-4894-a268-3feb81d913a9 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-70e64da7-1def-4894-a268-3feb81d913a9 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-70e64da7-1def-4894-a268-3feb81d913a9 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-70e64da7-1def-4894-a268-3feb81d913a9 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-70e64da7-1def-4894-a268-3feb81d913a9 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-70e64da7-1def-4894-a268-3feb81d913a9 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-70e64da7-1def-4894-a268-3feb81d913a9 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.048403 Apr 11 17:13:27 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 190/559] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 17:13:27 2023] GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:27 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:13:27 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-9af2b1f4-0393-438b-b9b7-04d991c04731 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a" status: 204 len: 0 microversion: 2.49 time: 0.111556 Apr 11 17:13:27 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 185/560] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:13:27 2023] DELETE /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:27 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a78f1b0eaee488f89af2d7d82cd9e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec2d39b4dbd0440c93734b0bab463b11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:27 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c848c7aa-6d7a-49ab-838c-760ac43f6273 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a" status: 200 len: 1754 microversion: 2.49 time: 0.195670 Apr 11 17:13:27 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 186/561] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:13:27 2023] GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:13:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3455d51c-e3e3-49c3-b61c-58ba7c4b72d4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:28 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-3455d51c-e3e3-49c3-b61c-58ba7c4b72d4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3455d51c-e3e3-49c3-b61c-58ba7c4b72d4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3455d51c-e3e3-49c3-b61c-58ba7c4b72d4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3455d51c-e3e3-49c3-b61c-58ba7c4b72d4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3455d51c-e3e3-49c3-b61c-58ba7c4b72d4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3455d51c-e3e3-49c3-b61c-58ba7c4b72d4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3455d51c-e3e3-49c3-b61c-58ba7c4b72d4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-unplugged", "status": "completed", "tag": "d5605470-2058-46dd-bc30-a8f0ba8c82db"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] Creating event network-vif-unplugged:d5605470-2058-46dd-bc30-a8f0ba8c82db for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:13:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-685ffb85-ef09-448e-bc90-ee19c9d535ce req-90a4db56-23ab-4bc5-ade4-b1792e9fbab7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106002 Apr 11 17:13:28 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 186/562] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-3455d51c-e3e3-49c3-b61c-58ba7c4b72d4 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.118680 Apr 11 17:13:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 191/563] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:13:28 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-interface => generated 282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:28 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] [instance: 5132062e-f602-4568-83ed-bc6fa2890300] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] HTTP exception thrown: Instance 5132062e-f602-4568-83ed-bc6fa2890300 could not be found. Apr 11 17:13:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Request method failure captured: Apr 11 17:13:28 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300 HTTP/1.1 Apr 11 17:13:28 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:13:28 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:13:28 user devstack@n-api.service[61422]: Connection: close Apr 11 17:13:28 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:13:28 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:13:28 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:13:28 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:13:28 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZPOSRNar875e6xDQ-Z9Cge2_6QCbcQ0G2pcTRPbJTQXcmW5pV3M7Rxf239mChpPUrV1JLk24QMgWcoaYKbOZTv08hM98Wv6o8U5CS1tvBCdCUEcgsfpWbELAkL4C86ENwMIVlYof6ieKS8Dcmj14NwMk_q6Sqd32QoJGROeGrtLLIw Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Project-Id: 3ab7d4c5adc544ef9ed9f774e1e144cc Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1455403265 Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ab7d4c5adc544ef9ed9f774e1e144cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3ab7d4c5adc544ef9ed9f774e1e144cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3ab7d4c5adc544ef9ed9f774e1e144cc"}]}] Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Tenant: tempest-VolumesSnapshotTestJSON-1455403265 Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Tenant-Id: 3ab7d4c5adc544ef9ed9f774e1e144cc Apr 11 17:13:28 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1455403265 Apr 11 17:13:28 user devstack@n-api.service[61422]: X-User: tempest-VolumesSnapshotTestJSON-1455403265-project-member Apr 11 17:13:28 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:13:28 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:13:28 user devstack@n-api.service[61422]: X-User-Id: 2878fecd141a4c0f97ead618b9cfdcbf Apr 11 17:13:28 user devstack@n-api.service[61422]: X-User-Name: tempest-VolumesSnapshotTestJSON-1455403265-project-member Apr 11 17:13:28 user devstack@n-api.service[61422]: method: > Apr 11 17:13:28 user devstack@n-api.service[61422]: exception: Instance 5132062e-f602-4568-83ed-bc6fa2890300 could not be found. Apr 11 17:13:28 user devstack@n-api.service[61422]: action_args: {'id': '5132062e-f602-4568-83ed-bc6fa2890300'} Apr 11 17:13:28 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5132062e-f602-4568-83ed-bc6fa2890300 could not be found. Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5132062e-f602-4568-83ed-bc6fa2890300 could not be found. Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5132062e-f602-4568-83ed-bc6fa2890300 could not be found. Apr 11 17:13:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:13:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] Returning 404 to user: Instance 5132062e-f602-4568-83ed-bc6fa2890300 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:13:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-fe76ce98-34da-434f-9d78-221d00dbaf3e tempest-VolumesSnapshotTestJSON-1455403265 tempest-VolumesSnapshotTestJSON-1455403265-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300" status: 404 len: 111 microversion: 2.1 time: 0.041213 Apr 11 17:13:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 187/564] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:13:28 2023] GET /compute/v2.1/servers/5132062e-f602-4568-83ed-bc6fa2890300 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:13:29 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:29 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] Creating event network-changed:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:13:29 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-c52a7433-e47c-4c0b-89d7-e48b860054c6 req-718ee7fd-d145-4f1b-bcd7-40fbc4c1a505 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033001 Apr 11 17:13:29 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 187/565] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:29 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1f959e0-9f24-4e52-b2d6-b756bc69d2e6"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:29 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:29 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-dcb4bdd6-8081-4b9e-857f-691dd72510d0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.434542 Apr 11 17:13:29 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 192/566] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:13:29 2023] POST /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-89816b00-3aad-4317-8e35-3963e9e73f26 req-651e1243-2461-4bdd-ad9e-5a448a81c56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-deleted", "tag": "d5605470-2058-46dd-bc30-a8f0ba8c82db"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-89816b00-3aad-4317-8e35-3963e9e73f26 req-651e1243-2461-4bdd-ad9e-5a448a81c56c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-89816b00-3aad-4317-8e35-3963e9e73f26 req-651e1243-2461-4bdd-ad9e-5a448a81c56c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-89816b00-3aad-4317-8e35-3963e9e73f26 req-651e1243-2461-4bdd-ad9e-5a448a81c56c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-89816b00-3aad-4317-8e35-3963e9e73f26 req-651e1243-2461-4bdd-ad9e-5a448a81c56c service nova] Creating event network-vif-deleted:d5605470-2058-46dd-bc30-a8f0ba8c82db for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:13:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-89816b00-3aad-4317-8e35-3963e9e73f26 req-651e1243-2461-4bdd-ad9e-5a448a81c56c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057158 Apr 11 17:13:29 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 188/567] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-plugged", "status": "completed", "tag": "d5605470-2058-46dd-bc30-a8f0ba8c82db"}, {"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-plugged", "status": "completed", "tag": "d5605470-2058-46dd-bc30-a8f0ba8c82db"}, {"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-plugged", "status": "completed", "tag": "d5605470-2058-46dd-bc30-a8f0ba8c82db"}, {"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-unplugged", "status": "completed", "tag": "d5605470-2058-46dd-bc30-a8f0ba8c82db"}, {"server_uuid": "9efebdaa-288e-42f5-af7d-ca64963be57a", "name": "network-vif-plugged", "status": "completed", "tag": "d5605470-2058-46dd-bc30-a8f0ba8c82db"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Creating event network-vif-plugged:d5605470-2058-46dd-bc30-a8f0ba8c82db for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:13:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Creating event network-vif-plugged:d5605470-2058-46dd-bc30-a8f0ba8c82db for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:13:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Creating event network-vif-plugged:d5605470-2058-46dd-bc30-a8f0ba8c82db for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:13:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Creating event network-vif-unplugged:d5605470-2058-46dd-bc30-a8f0ba8c82db for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:13:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] Creating event network-vif-plugged:d5605470-2058-46dd-bc30-a8f0ba8c82db for instance 9efebdaa-288e-42f5-af7d-ca64963be57a on user Apr 11 17:13:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-947165ff-800c-4c30-bfb6-36841b88d2b3 req-66389612-4683-4a50-a48b-ea66bcbd2df9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.050058 Apr 11 17:13:30 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 188/568] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:30 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:36 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1196613848"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:36 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:36 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:36 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] HTTP exception thrown: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:13:36 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Request method failure captured: Apr 11 17:13:36 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 HTTP/1.1 Apr 11 17:13:36 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:13:36 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:13:36 user devstack@n-api.service[61422]: Connection: close Apr 11 17:13:36 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:13:36 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:13:36 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:13:36 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:13:36 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLN4vXvHRPKKWDW-ECm5G6uEioG308kpFEqrgJPleriLUll5XZ040XKXQaSBKStHyg2-xIpLQ0BCmtB27xgjjJTcCPN38-KW8ExTMPs7FPMY6El7X0KNM1_glwVcXpRd7Y188tCn5vB_LI_SwS5AQw4GeEnTI7GCoLMd5Zw-_lInLI Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Project-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}] Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Tenant-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:13:36 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:13:36 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:13:36 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:13:36 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:13:36 user devstack@n-api.service[61422]: X-User-Id: ac0109eab2dc45fe824a03e2d09fa022 Apr 11 17:13:36 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:13:36 user devstack@n-api.service[61422]: method: > Apr 11 17:13:36 user devstack@n-api.service[61422]: exception: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:13:36 user devstack@n-api.service[61422]: action_args: {'id': 'd9cb0b86-5d7d-4d78-a6a0-632cebb4cc32'} Apr 11 17:13:36 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:13:36 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:13:36 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Returning 404 to user: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:13:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e3c08497-3c41-408d-b6a4-674c8029ec76 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 404 len: 111 microversion: 2.1 time: 0.031575 Apr 11 17:13:36 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 189/569] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:13:36 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:13:36 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-cbc249a4-9a2e-4df7-b925-d50d53b29a4a tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '.version_select at 0x7f5bdd73c160>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:36 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-cbc249a4-9a2e-4df7-b925-d50d53b29a4a tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-449429725" status: 202 len: 0 microversion: 2.1 time: 0.022966 Apr 11 17:13:36 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 189/570] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 17:13:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-449429725 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:13:37 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-b7430fc8-595b-4212-b8e7-f0d5cdde4f37 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a/action" status: 202 len: 52 microversion: 2.87 time: 0.902360 Apr 11 17:13:37 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 193/571] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 17:13:36 2023] POST /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a/action => generated 52 bytes in 904 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 17:13:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b4e1aa51-2cbf-4fdd-ad45-ef4923f201ac tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd8377f0>, body: {"keypair": {"name": "tempest-keypair-1520901621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLGA7ITRVNn7GjLSzkVsG9qllpiTLCnVwtVaAGuq9WnIK8VQYMWagqSqLSEUWmmtBFT/JnilDnpp1MRrDJ/InQ4R18JevW4oC7hjIRIQnHR5O9JyvqVM7iBsqyLgBUo4A=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:37 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-b4e1aa51-2cbf-4fdd-ad45-ef4923f201ac tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting quotas for project 3c902eb30be24cc6bd26c0ab7036d037. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:13:37 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-b4e1aa51-2cbf-4fdd-ad45-ef4923f201ac tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting quotas for user ac0109eab2dc45fe824a03e2d09fa022 and project 3c902eb30be24cc6bd26c0ab7036d037. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:13:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b4e1aa51-2cbf-4fdd-ad45-ef4923f201ac tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044918 Apr 11 17:13:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 190/572] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:13:37 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:37 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:37 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'flavor' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:13:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-beedbb36-a3cf-4b17-aa19-5727d747eef5 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/action" status: 200 len: 32 microversion: 2.1 time: 0.275182 Apr 11 17:13:37 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 190/573] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:13:37 2023] POST /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:13:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-af984e11-7c56-4563-8ad3-0f666bcf5954 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:37 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-af984e11-7c56-4563-8ad3-0f666bcf5954 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af984e11-7c56-4563-8ad3-0f666bcf5954 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af984e11-7c56-4563-8ad3-0f666bcf5954 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af984e11-7c56-4563-8ad3-0f666bcf5954 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af984e11-7c56-4563-8ad3-0f666bcf5954 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af984e11-7c56-4563-8ad3-0f666bcf5954 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af984e11-7c56-4563-8ad3-0f666bcf5954 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:37 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-af984e11-7c56-4563-8ad3-0f666bcf5954 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:37 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-af984e11-7c56-4563-8ad3-0f666bcf5954 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" status: 200 len: 1721 microversion: 2.1 time: 0.280735 Apr 11 17:13:37 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 194/574] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:13:37 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:13:38 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-unplugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] Creating event network-vif-unplugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:13:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-cdb88f19-de79-4adc-84fc-9f563a4b9288 req-bd0a83fe-8db7-4b31-a217-bada89771048 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035136 Apr 11 17:13:38 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 191/575] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1673575885", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "6fe2f45e-c84e-4b74-af4a-118b0bfc9824"}], "security_groups": [{"name": "tempest-securitygroup--1355799245"}], "key_name": "tempest-keypair-1520901621", "user_data": "}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] validate_networks() for [('6fe2f45e-c84e-4b74-af4a-118b0bfc9824', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting quotas for project 3c902eb30be24cc6bd26c0ab7036d037. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Getting quotas for user ac0109eab2dc45fe824a03e2d09fa022 and project 3c902eb30be24cc6bd26c0ab7036d037. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:13:39 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:13:40 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2744f867-b47f-4e86-8c4a-7b0143e5425f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.956137 Apr 11 17:13:40 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 191/576] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:13:39 2023] POST /compute/v2.1/servers => generated 400 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:13:40 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f1b29f22-b292-47d7-b4ad-527c97519e42 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:40 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f1b29f22-b292-47d7-b4ad-527c97519e42 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:40 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-f1b29f22-b292-47d7-b4ad-527c97519e42 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:40 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f1b29f22-b292-47d7-b4ad-527c97519e42 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5" status: 200 len: 1232 microversion: 2.1 time: 0.076161 Apr 11 17:13:40 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 195/577] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:13:40 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5 => generated 1232 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:13:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-plugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] Creating event network-vif-plugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:13:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-d4358b02-8867-4e0e-be42-1f4c9258af0a req-ec61c51b-d4ef-4cc5-9a74-9203db89cd68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027675 Apr 11 17:13:40 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 192/578] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:42 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-plugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}, {"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-plugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:42 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Creating event network-vif-plugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:13:42 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] Creating event network-vif-plugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:13:42 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-e00c6c5a-dd47-4caf-854b-97c6bf8d9875 req-3f7b2cf8-cb0b-4d43-aada-6c737e538f2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048114 Apr 11 17:13:42 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 192/579] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:43 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:43 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:43 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:43 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:43 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:43 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-5e4a2adc-13a2-45ef-8794-69412a761dc3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a" status: 200 len: 1691 microversion: 2.87 time: 0.206271 Apr 11 17:13:43 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 196/580] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:13:43 2023] GET /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a => generated 1691 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:13:43 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771531ad-b1f4-486a-b70f-f46837df58b5", "tag": "468963af-7fdf-43f9-9be8-b1569345361e"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:43 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] Creating event network-changed:468963af-7fdf-43f9-9be8-b1569345361e for instance 771531ad-b1f4-486a-b70f-f46837df58b5 on user Apr 11 17:13:43 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-0800d134-e091-475d-8b95-a6c79916a772 req-7db3e6d3-bba7-4b5a-9eaf-0910fe2f9200 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058077 Apr 11 17:13:43 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 193/581] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:46 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771531ad-b1f4-486a-b70f-f46837df58b5", "name": "network-vif-plugged", "status": "completed", "tag": "468963af-7fdf-43f9-9be8-b1569345361e"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:46 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] Creating event network-vif-plugged:468963af-7fdf-43f9-9be8-b1569345361e for instance 771531ad-b1f4-486a-b70f-f46837df58b5 on user Apr 11 17:13:46 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-871ad802-5895-4faf-8ece-a1cc49ebccaf req-6372407b-9e51-4b80-8f95-24cd2e9a96d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222425 Apr 11 17:13:46 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 193/582] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:48 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:48 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:48 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-d357ca61-72f7-4b6e-a232-39b4dbc265eb tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/action" status: 202 len: 0 microversion: 2.1 time: 0.177487 Apr 11 17:13:48 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 197/583] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:13:48 2023] POST /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:13:48 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:13:48 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-89c73857-ea5e-488f-b33b-a94206181ef7 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:13:48 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-89c73857-ea5e-488f-b33b-a94206181ef7 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:13:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89c73857-ea5e-488f-b33b-a94206181ef7 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89c73857-ea5e-488f-b33b-a94206181ef7 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89c73857-ea5e-488f-b33b-a94206181ef7 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89c73857-ea5e-488f-b33b-a94206181ef7 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89c73857-ea5e-488f-b33b-a94206181ef7 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89c73857-ea5e-488f-b33b-a94206181ef7 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:48 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-89c73857-ea5e-488f-b33b-a94206181ef7 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:13:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-89c73857-ea5e-488f-b33b-a94206181ef7 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1729 microversion: 2.1 time: 0.164009 Apr 11 17:13:48 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 194/584] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:13:48 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:13:48 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771531ad-b1f4-486a-b70f-f46837df58b5", "name": "network-vif-plugged", "status": "completed", "tag": "468963af-7fdf-43f9-9be8-b1569345361e"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] Creating event network-vif-plugged:468963af-7fdf-43f9-9be8-b1569345361e for instance 771531ad-b1f4-486a-b70f-f46837df58b5 on user Apr 11 17:13:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-e067ddcd-7a1a-414f-b4cb-9eecdbbc712c req-eb3d79b1-f85b-4f4b-ab8a-5a4e415e66a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029375 Apr 11 17:13:48 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 194/585] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:49 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-unplugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:49 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] Creating event network-vif-unplugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:13:49 user devstack@n-api.service[61424]: DEBUG nova.compute.api [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61424) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:13:49 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-3e8234bc-517d-44d8-a5c9-ecc2190f00b1 req-9cd4f579-b6e7-48a0-86a3-c29375c195cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043831 Apr 11 17:13:49 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 198/586] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:13:51 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:13:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:13:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:13:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:13:51 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:13:51 user devstack@n-api.service[61422]: DEBUG nova.compute.api [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61422) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:13:51 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-8087257f-57ab-40b8-aec3-a65c253afdb5 req-cf413bff-69f5-4749-884b-dae485a06d50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052049 Apr 11 17:13:51 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 195/587] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:13:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:14:01 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:01 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:01 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:01 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:01 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:01 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:14:01 user devstack@n-api.service[61423]: DEBUG nova.compute.api [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61423) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:14:01 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-9b5a81d3-eb84-46ad-ba4c-1ea3be6c5488 req-f5de7796-02a6-4542-9180-9a226dc08862 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066635 Apr 11 17:14:01 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 195/588] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:14:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=7,nova_cell1:INSERT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] [instance: dba29188-c963-44d4-95fa-09bffbcb8dca] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] HTTP exception thrown: Instance dba29188-c963-44d4-95fa-09bffbcb8dca could not be found. Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Request method failure captured: Apr 11 17:14:01 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca HTTP/1.1 Apr 11 17:14:01 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:14:01 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:14:01 user devstack@n-api.service[61424]: Connection: close Apr 11 17:14:01 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:14:01 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:14:01 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:14:01 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:14:01 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZPE8VJ1QnzVc7Dp8Vy51XNy39PC5rId6sPmgH_LNtqn3A1xUQii59WRlKrZ9JAUYW_aimdHhNSWNwoE9r-Jmg3wIA81cVZp7nKUYhixgEE6sb3qjR0jPuYX4HvgBkdUWpQMopBnr4Zj-IF27p7nBlvzbt-LCxU6PTpUm6EHgJVwqR4 Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Project-Id: bf2f734d27a049e7b97ba50db0db0b6c Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Project-Name: tempest-TestShelveInstance-720963145 Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf2f734d27a049e7b97ba50db0db0b6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf2f734d27a049e7b97ba50db0db0b6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf2f734d27a049e7b97ba50db0db0b6c"}]}] Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Tenant: tempest-TestShelveInstance-720963145 Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Tenant-Id: bf2f734d27a049e7b97ba50db0db0b6c Apr 11 17:14:01 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-TestShelveInstance-720963145 Apr 11 17:14:01 user devstack@n-api.service[61424]: X-User: tempest-TestShelveInstance-720963145-project-member Apr 11 17:14:01 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:14:01 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:14:01 user devstack@n-api.service[61424]: X-User-Id: ea404079db924f70b4a22278cee452dc Apr 11 17:14:01 user devstack@n-api.service[61424]: X-User-Name: tempest-TestShelveInstance-720963145-project-member Apr 11 17:14:01 user devstack@n-api.service[61424]: method: > Apr 11 17:14:01 user devstack@n-api.service[61424]: exception: Instance dba29188-c963-44d4-95fa-09bffbcb8dca could not be found. Apr 11 17:14:01 user devstack@n-api.service[61424]: action_args: {'id': 'dba29188-c963-44d4-95fa-09bffbcb8dca'} Apr 11 17:14:01 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dba29188-c963-44d4-95fa-09bffbcb8dca could not be found. Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dba29188-c963-44d4-95fa-09bffbcb8dca could not be found. Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dba29188-c963-44d4-95fa-09bffbcb8dca could not be found. Apr 11 17:14:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:14:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Returning 404 to user: Instance dba29188-c963-44d4-95fa-09bffbcb8dca could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:14:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-088dae34-eef4-4204-a8b9-e583e89be517 tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca" status: 404 len: 111 microversion: 2.1 time: 0.058624 Apr 11 17:14:01 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 199/589] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:14:01 2023] GET /compute/v2.1/servers/dba29188-c963-44d4-95fa-09bffbcb8dca => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:14:01 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:01 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=36 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8e80920a-66ca-438f-af8d-62eaf10fc5ca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] Calling method '.version_select at 0x7f5bdd640a60>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8e80920a-66ca-438f-af8d-62eaf10fc5ca tempest-TestShelveInstance-720963145 tempest-TestShelveInstance-720963145-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1839642534" status: 202 len: 0 microversion: 2.1 time: 0.029670 Apr 11 17:14:01 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 196/590] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 17:14:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1839642534 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:14:03 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:03 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:14:03 user devstack@n-api.service[61423]: DEBUG nova.compute.api [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61423) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:14:03 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-e316effc-565a-4ac5-bbce-02ee937825be req-b08c042c-57dd-43d9-9885-dc7169e75690 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052196 Apr 11 17:14:03 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 196/591] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:14:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:14:07 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-8db529a1-f712-44cd-9d32-4032a07b3bb7 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:07 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-8db529a1-f712-44cd-9d32-4032a07b3bb7 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8db529a1-f712-44cd-9d32-4032a07b3bb7 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8db529a1-f712-44cd-9d32-4032a07b3bb7 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8db529a1-f712-44cd-9d32-4032a07b3bb7 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8db529a1-f712-44cd-9d32-4032a07b3bb7 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8db529a1-f712-44cd-9d32-4032a07b3bb7 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8db529a1-f712-44cd-9d32-4032a07b3bb7 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:08 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-8db529a1-f712-44cd-9d32-4032a07b3bb7 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:08 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-8db529a1-f712-44cd-9d32-4032a07b3bb7 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705" status: 200 len: 1493 microversion: 2.1 time: 0.223745 Apr 11 17:14:08 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 200/592] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:14:07 2023] GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705 => generated 1493 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-44fb9ca9-453a-4edd-873f-05850dbecdcc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-44fb9ca9-453a-4edd-873f-05850dbecdcc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-44fb9ca9-453a-4edd-873f-05850dbecdcc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-44fb9ca9-453a-4edd-873f-05850dbecdcc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-44fb9ca9-453a-4edd-873f-05850dbecdcc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-44fb9ca9-453a-4edd-873f-05850dbecdcc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-44fb9ca9-453a-4edd-873f-05850dbecdcc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-44fb9ca9-453a-4edd-873f-05850dbecdcc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-44fb9ca9-453a-4edd-873f-05850dbecdcc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:14 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-44fb9ca9-453a-4edd-873f-05850dbecdcc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33" status: 200 len: 1378 microversion: 2.1 time: 0.150391 Apr 11 17:14:14 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 197/593] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:14:14 2023] GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 => generated 1378 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:14:14 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:14 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:14 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-9ea80faf-bce7-4227-b49d-dc072cb365ad tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:14 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-9ea80faf-bce7-4227-b49d-dc072cb365ad tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9ea80faf-bce7-4227-b49d-dc072cb365ad tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9ea80faf-bce7-4227-b49d-dc072cb365ad tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9ea80faf-bce7-4227-b49d-dc072cb365ad tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9ea80faf-bce7-4227-b49d-dc072cb365ad tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9ea80faf-bce7-4227-b49d-dc072cb365ad tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9ea80faf-bce7-4227-b49d-dc072cb365ad tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:14 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-9ea80faf-bce7-4227-b49d-dc072cb365ad tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:14 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-9ea80faf-bce7-4227-b49d-dc072cb365ad tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33" status: 200 len: 1378 microversion: 2.1 time: 0.164548 Apr 11 17:14:14 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 197/594] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:14:14 2023] GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 => generated 1378 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:14:14 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:14 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:14 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:14 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:14:14 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-57587a6a-a326-4bec-9d22-937f049de338 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33" status: 204 len: 0 microversion: 2.1 time: 0.166695 Apr 11 17:14:14 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 201/595] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:14:14 2023] DELETE /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-68e59242-bf43-4d89-b1ed-08fe04ffadaa tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-68e59242-bf43-4d89-b1ed-08fe04ffadaa tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68e59242-bf43-4d89-b1ed-08fe04ffadaa tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68e59242-bf43-4d89-b1ed-08fe04ffadaa tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68e59242-bf43-4d89-b1ed-08fe04ffadaa tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68e59242-bf43-4d89-b1ed-08fe04ffadaa tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68e59242-bf43-4d89-b1ed-08fe04ffadaa tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68e59242-bf43-4d89-b1ed-08fe04ffadaa tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:15 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-68e59242-bf43-4d89-b1ed-08fe04ffadaa tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-68e59242-bf43-4d89-b1ed-08fe04ffadaa tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33" status: 200 len: 1384 microversion: 2.1 time: 0.189328 Apr 11 17:14:15 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 198/596] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:14:14 2023] GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 => generated 1384 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:14:15 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821c0f5c-2011-443d-9455-49cc9e317e33", "name": "network-vif-unplugged", "status": "completed", "tag": "5ed86986-3eff-4f85-83ed-3db9257c5ec9"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:15 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:15 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:15 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:15 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] Creating event network-vif-unplugged:5ed86986-3eff-4f85-83ed-3db9257c5ec9 for instance 821c0f5c-2011-443d-9455-49cc9e317e33 on user Apr 11 17:14:15 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-c57d3720-025d-4a95-bfb8-c876233755af req-88d866bf-09ef-4f20-b638-f091e67bd17e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044845 Apr 11 17:14:15 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 198/597] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:14:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:14:17 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821c0f5c-2011-443d-9455-49cc9e317e33", "name": "network-vif-plugged", "status": "completed", "tag": "5ed86986-3eff-4f85-83ed-3db9257c5ec9"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:17 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] Creating event network-vif-plugged:5ed86986-3eff-4f85-83ed-3db9257c5ec9 for instance 821c0f5c-2011-443d-9455-49cc9e317e33 on user Apr 11 17:14:17 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-ecd82c10-9cf7-467b-9bd2-7082b232d529 req-bd3334cd-0123-4a89-996f-24971936fa33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040123 Apr 11 17:14:17 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 202/598] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:14:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:14:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-83735953-4172-40e4-9def-131e70fb8d25 req-6dbf2dfe-5696-4e63-9c40-9242d6380ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821c0f5c-2011-443d-9455-49cc9e317e33", "name": "network-vif-deleted", "tag": "5ed86986-3eff-4f85-83ed-3db9257c5ec9"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-83735953-4172-40e4-9def-131e70fb8d25 req-6dbf2dfe-5696-4e63-9c40-9242d6380ac9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-83735953-4172-40e4-9def-131e70fb8d25 req-6dbf2dfe-5696-4e63-9c40-9242d6380ac9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-83735953-4172-40e4-9def-131e70fb8d25 req-6dbf2dfe-5696-4e63-9c40-9242d6380ac9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-83735953-4172-40e4-9def-131e70fb8d25 req-6dbf2dfe-5696-4e63-9c40-9242d6380ac9 service nova] Creating event network-vif-deleted:5ed86986-3eff-4f85-83ed-3db9257c5ec9 for instance 821c0f5c-2011-443d-9455-49cc9e317e33 on user Apr 11 17:14:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-83735953-4172-40e4-9def-131e70fb8d25 req-6dbf2dfe-5696-4e63-9c40-9242d6380ac9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034522 Apr 11 17:14:17 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 199/599] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:14:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:14:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:18 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:18 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] HTTP exception thrown: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Request method failure captured: Apr 11 17:14:18 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a HTTP/1.1 Apr 11 17:14:18 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:14:18 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:14:18 user devstack@n-api.service[61423]: Connection: close Apr 11 17:14:18 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:14:18 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:14:18 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:14:18 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:14:18 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZR4Hgaulmz1Z6y3STH8obdVEpQr7BQ5dn6naAsQcK4-MNI1i7Jcnzko7DIg4plAwBRnGKqwhIbXxE9nV3zUK5piLbhj8gc1m6HEzg66exPnfH8MFj73A2B_bAAaPCDryQz4N6YgIzmRmtTk1jswAwPI_qtenj_T52MfaugPs6M8F8M Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Project-Id: ec2d39b4dbd0440c93734b0bab463b11 Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Project-Name: tempest-TaggedAttachmentsTest-1294682350 Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec2d39b4dbd0440c93734b0bab463b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec2d39b4dbd0440c93734b0bab463b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec2d39b4dbd0440c93734b0bab463b11"}]}] Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Tenant: tempest-TaggedAttachmentsTest-1294682350 Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Tenant-Id: ec2d39b4dbd0440c93734b0bab463b11 Apr 11 17:14:18 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1294682350 Apr 11 17:14:18 user devstack@n-api.service[61423]: X-User: tempest-TaggedAttachmentsTest-1294682350-project-member Apr 11 17:14:18 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:14:18 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:14:18 user devstack@n-api.service[61423]: X-User-Id: 1a78f1b0eaee488f89af2d7d82cd9e08 Apr 11 17:14:18 user devstack@n-api.service[61423]: X-User-Name: tempest-TaggedAttachmentsTest-1294682350-project-member Apr 11 17:14:18 user devstack@n-api.service[61423]: method: > Apr 11 17:14:18 user devstack@n-api.service[61423]: exception: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:18 user devstack@n-api.service[61423]: action_args: {'id': '9efebdaa-288e-42f5-af7d-ca64963be57a'} Apr 11 17:14:18 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:14:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Returning 404 to user: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:14:18 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-a7965729-325c-4219-9294-de752433b5ef tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a" status: 404 len: 111 microversion: 2.49 time: 0.030373 Apr 11 17:14:18 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 199/600] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:14:18 2023] GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:14:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-849966ff-dc40-4f26-beeb-d407d9b2c4de tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '.version_select at 0x7f5bdd82a8c0>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-849966ff-dc40-4f26-beeb-d407d9b2c4de tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138093427" status: 204 len: 0 microversion: 2.49 time: 0.024575 Apr 11 17:14:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 203/601] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 17:14:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138093427 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:14:19 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:19 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] HTTP exception thrown: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:19 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Request method failure captured: Apr 11 17:14:19 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a HTTP/1.1 Apr 11 17:14:19 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:14:19 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:14:19 user devstack@n-api.service[61422]: Connection: close Apr 11 17:14:19 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:14:19 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:14:19 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:14:19 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:14:19 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZR4Hgaulmz1Z6y3STH8obdVEpQr7BQ5dn6naAsQcK4-MNI1i7Jcnzko7DIg4plAwBRnGKqwhIbXxE9nV3zUK5piLbhj8gc1m6HEzg66exPnfH8MFj73A2B_bAAaPCDryQz4N6YgIzmRmtTk1jswAwPI_qtenj_T52MfaugPs6M8F8M Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Project-Id: ec2d39b4dbd0440c93734b0bab463b11 Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Project-Name: tempest-TaggedAttachmentsTest-1294682350 Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec2d39b4dbd0440c93734b0bab463b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec2d39b4dbd0440c93734b0bab463b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec2d39b4dbd0440c93734b0bab463b11"}]}] Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Tenant: tempest-TaggedAttachmentsTest-1294682350 Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Tenant-Id: ec2d39b4dbd0440c93734b0bab463b11 Apr 11 17:14:19 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1294682350 Apr 11 17:14:19 user devstack@n-api.service[61422]: X-User: tempest-TaggedAttachmentsTest-1294682350-project-member Apr 11 17:14:19 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:14:19 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:14:19 user devstack@n-api.service[61422]: X-User-Id: 1a78f1b0eaee488f89af2d7d82cd9e08 Apr 11 17:14:19 user devstack@n-api.service[61422]: X-User-Name: tempest-TaggedAttachmentsTest-1294682350-project-member Apr 11 17:14:19 user devstack@n-api.service[61422]: method: > Apr 11 17:14:19 user devstack@n-api.service[61422]: exception: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:19 user devstack@n-api.service[61422]: action_args: {'id': '9efebdaa-288e-42f5-af7d-ca64963be57a'} Apr 11 17:14:19 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:19 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:14:19 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Returning 404 to user: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:14:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e23bb24c-1c4d-4b55-8d35-43740ed60a52 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a" status: 404 len: 111 microversion: 2.49 time: 0.031127 Apr 11 17:14:19 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 200/602] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:14:19 2023] DELETE /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:14:19 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:19 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] [instance: 9efebdaa-288e-42f5-af7d-ca64963be57a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:19 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] HTTP exception thrown: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:19 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Request method failure captured: Apr 11 17:14:19 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a HTTP/1.1 Apr 11 17:14:19 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:14:19 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:14:19 user devstack@n-api.service[61423]: Connection: close Apr 11 17:14:19 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:14:19 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:14:19 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:14:19 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:14:19 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZR4Hgaulmz1Z6y3STH8obdVEpQr7BQ5dn6naAsQcK4-MNI1i7Jcnzko7DIg4plAwBRnGKqwhIbXxE9nV3zUK5piLbhj8gc1m6HEzg66exPnfH8MFj73A2B_bAAaPCDryQz4N6YgIzmRmtTk1jswAwPI_qtenj_T52MfaugPs6M8F8M Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Project-Id: ec2d39b4dbd0440c93734b0bab463b11 Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Project-Name: tempest-TaggedAttachmentsTest-1294682350 Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec2d39b4dbd0440c93734b0bab463b11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec2d39b4dbd0440c93734b0bab463b11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec2d39b4dbd0440c93734b0bab463b11"}]}] Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Tenant: tempest-TaggedAttachmentsTest-1294682350 Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Tenant-Id: ec2d39b4dbd0440c93734b0bab463b11 Apr 11 17:14:19 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-TaggedAttachmentsTest-1294682350 Apr 11 17:14:19 user devstack@n-api.service[61423]: X-User: tempest-TaggedAttachmentsTest-1294682350-project-member Apr 11 17:14:19 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:14:19 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:14:19 user devstack@n-api.service[61423]: X-User-Id: 1a78f1b0eaee488f89af2d7d82cd9e08 Apr 11 17:14:19 user devstack@n-api.service[61423]: X-User-Name: tempest-TaggedAttachmentsTest-1294682350-project-member Apr 11 17:14:19 user devstack@n-api.service[61423]: method: > Apr 11 17:14:19 user devstack@n-api.service[61423]: exception: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:19 user devstack@n-api.service[61423]: action_args: {'id': '9efebdaa-288e-42f5-af7d-ca64963be57a'} Apr 11 17:14:19 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. Apr 11 17:14:19 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:14:19 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] Returning 404 to user: Instance 9efebdaa-288e-42f5-af7d-ca64963be57a could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:14:19 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-5f46a421-c2b4-4ad6-b867-937654b19075 tempest-TaggedAttachmentsTest-1294682350 tempest-TaggedAttachmentsTest-1294682350-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a" status: 404 len: 111 microversion: 2.49 time: 0.029965 Apr 11 17:14:19 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 200/603] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:14:19 2023] GET /compute/v2.1/servers/9efebdaa-288e-42f5-af7d-ca64963be57a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:14:28 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:28 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-0d5af626-9131-4aca-8f30-69972c7285ab tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:28 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-0d5af626-9131-4aca-8f30-69972c7285ab tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d5af626-9131-4aca-8f30-69972c7285ab tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d5af626-9131-4aca-8f30-69972c7285ab tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d5af626-9131-4aca-8f30-69972c7285ab tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d5af626-9131-4aca-8f30-69972c7285ab tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d5af626-9131-4aca-8f30-69972c7285ab tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d5af626-9131-4aca-8f30-69972c7285ab tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:28 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0d5af626-9131-4aca-8f30-69972c7285ab tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-0d5af626-9131-4aca-8f30-69972c7285ab tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" status: 200 len: 1701 microversion: 2.1 time: 0.439223 Apr 11 17:14:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 204/604] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:14:28 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => generated 1701 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:14:30 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=8 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:30 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=16 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:30 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d6d8ce27-1e0b-4ebc-887f-6eb1cbf3692f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:30 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d6d8ce27-1e0b-4ebc-887f-6eb1cbf3692f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6d8ce27-1e0b-4ebc-887f-6eb1cbf3692f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6d8ce27-1e0b-4ebc-887f-6eb1cbf3692f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6d8ce27-1e0b-4ebc-887f-6eb1cbf3692f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6d8ce27-1e0b-4ebc-887f-6eb1cbf3692f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6d8ce27-1e0b-4ebc-887f-6eb1cbf3692f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d6d8ce27-1e0b-4ebc-887f-6eb1cbf3692f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:30 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-d6d8ce27-1e0b-4ebc-887f-6eb1cbf3692f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d6d8ce27-1e0b-4ebc-887f-6eb1cbf3692f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5" status: 200 len: 1539 microversion: 2.1 time: 0.343231 Apr 11 17:14:30 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 201/605] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:14:30 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5 => generated 1539 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:14:34 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:34 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=12 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:34 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2c6c59c0-fea9-4255-82e3-c69a9a3c6c66 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd7d1240>, body: {"keypair": {"name": "tempest-keypair-385713192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFqFHOn8aPRX0q5MSRPMTTacpD4HYx1m4dQ1XGm7PdPNjP6f9xXOv0GIXZGtAqKHrXu3xeE1uYxfyAMROxwbD8IK2W1cFmzOptY72oYUTM7AtAciDDzgNoF5MkpmQhYKg=="}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:34 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-2c6c59c0-fea9-4255-82e3-c69a9a3c6c66 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting quotas for project fce268052b8046e5a7efa41048e96645. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:14:34 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-2c6c59c0-fea9-4255-82e3-c69a9a3c6c66 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting quotas for user b69069a1461d485598e2078cc12772a5 and project fce268052b8046e5a7efa41048e96645. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:14:34 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2c6c59c0-fea9-4255-82e3-c69a9a3c6c66 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.104695 Apr 11 17:14:34 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 201/606] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 17:14:34 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2104871241", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ab158a7f-12de-4735-97b5-6ffa89762d09"}], "security_groups": [{"name": "tempest-securitygroup--195711795"}], "key_name": "tempest-keypair-385713192", "user_data": "}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG nova.network.neutron [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] validate_networks() for [('ab158a7f-12de-4735-97b5-6ffa89762d09', None, None, None, None, None)] {{(pid=61424) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:37 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting quotas for project fce268052b8046e5a7efa41048e96645. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:14:37 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting quotas for user b69069a1461d485598e2078cc12772a5 and project fce268052b8046e5a7efa41048e96645. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:14:37 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Going to run 1 instances... {{(pid=61424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:14:37 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:14:37 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-76cd8684-3793-47b7-826f-35d4a3dbb7d4 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.620086 Apr 11 17:14:37 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 205/607] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 17:14:36 2023] POST /compute/v2.1/servers => generated 399 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 17:14:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c764b1a8-56d3-4fa2-9024-7d8f8a8e83bb tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:37 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c764b1a8-56d3-4fa2-9024-7d8f8a8e83bb tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:37 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-c764b1a8-56d3-4fa2-9024-7d8f8a8e83bb tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:37 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-c764b1a8-56d3-4fa2-9024-7d8f8a8e83bb tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:37 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-c764b1a8-56d3-4fa2-9024-7d8f8a8e83bb tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c764b1a8-56d3-4fa2-9024-7d8f8a8e83bb tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2" status: 200 len: 1275 microversion: 2.20 time: 0.067569 Apr 11 17:14:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 202/608] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:14:37 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 => generated 1275 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:14:38 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a98f9e54-232c-4c79-8cf5-41e34cc01823 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:38 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-a98f9e54-232c-4c79-8cf5-41e34cc01823 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a98f9e54-232c-4c79-8cf5-41e34cc01823 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a98f9e54-232c-4c79-8cf5-41e34cc01823 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a98f9e54-232c-4c79-8cf5-41e34cc01823 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a98f9e54-232c-4c79-8cf5-41e34cc01823 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a98f9e54-232c-4c79-8cf5-41e34cc01823 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a98f9e54-232c-4c79-8cf5-41e34cc01823 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:38 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-a98f9e54-232c-4c79-8cf5-41e34cc01823 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:38 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-a98f9e54-232c-4c79-8cf5-41e34cc01823 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1722 microversion: 2.1 time: 0.228086 Apr 11 17:14:38 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 202/609] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:14:38 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:14:39 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] Creating event network-changed:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:14:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-85b7c5b6-cb08-4e88-845d-1e24cfcd3646 req-b8ee93c9-8912-4783-bb95-5854f042e8a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036611 Apr 11 17:14:39 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 206/610] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:14:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:14:42 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "name": "network-vif-plugged", "status": "completed", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:42 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:42 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] Creating event network-vif-plugged:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:14:42 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-cadb7cd9-5a6b-4837-8150-614a027afdc3 req-40ccfafd-3ee9-4950-b8f3-09157ed582a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034386 Apr 11 17:14:42 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 203/611] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:14:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:14:43 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1632176154", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "destination_type": "volume"}], "networks": [{"uuid": "f3262209-0a5c-4763-99ae-a8319122d98c"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:43 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] validate_networks() for [('f3262209-0a5c-4763-99ae-a8319122d98c', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:14:44 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "name": "network-vif-plugged", "status": "completed", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:44 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:44 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] Creating event network-vif-plugged:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:14:44 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-bb8896df-5dfe-41dd-b88b-c9916b49b20c req-e5287ac5-401a-44fb-82c8-8f48b0ffefba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043971 Apr 11 17:14:44 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 207/612] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting quotas for project 361d59e2f9ac4a68a1a738cc3f2a9d14. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Getting quotas for user 79b5fefb1e9748b8bf51535099bf5327 and project 361d59e2f9ac4a68a1a738cc3f2a9d14. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:14:44 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:14:44 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-de4c0e0b-f0da-4808-8e43-24c0a9c8ae8b tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.573217 Apr 11 17:14:44 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 203/613] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 17:14:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 17:14:44 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-bfa65de7-e398-4d06-933e-73dd9d0e65a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:14:44 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-bfa65de7-e398-4d06-933e-73dd9d0e65a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:14:44 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-bfa65de7-e398-4d06-933e-73dd9d0e65a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:44 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-bfa65de7-e398-4d06-933e-73dd9d0e65a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:44 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-bfa65de7-e398-4d06-933e-73dd9d0e65a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:14:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-bfa65de7-e398-4d06-933e-73dd9d0e65a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" status: 200 len: 1395 microversion: 2.87 time: 0.082907 Apr 11 17:14:44 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 204/614] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:14:44 2023] GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => generated 1395 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:14:47 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:47 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:47 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] Creating event network-changed:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:14:47 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-ed8a1856-2352-43c1-8d3d-dfb5e4130ec6 req-01b7fb24-7e3a-488b-a304-1524b32eea72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048141 Apr 11 17:14:47 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 208/615] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:14:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:14:58 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:58 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:58 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=10 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:58 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:14:58 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-plugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:14:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:14:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:14:58 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:14:58 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] Creating event network-vif-plugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:14:58 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-e346e3bc-01a2-4adb-8489-7707cd27390d req-f887918d-ffe3-4bae-a043-c6bdc110d66a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093689 Apr 11 17:14:58 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 204/616] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:14:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:00 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-plugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:00 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:00 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:00 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=14 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:00 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] Creating event network-vif-plugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:15:00 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-0cb7a265-54a7-4195-99c1-22defd92d199 req-8f631753-6e17-4ad7-af14-dd8acfa07a7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035858 Apr 11 17:15:00 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 205/617] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:15:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=14 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:05 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:15:05 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 HTTP/1.1 Apr 11 17:15:05 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:15:05 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:15:05 user devstack@n-api.service[61424]: Connection: close Apr 11 17:15:05 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:15:05 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:15:05 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:15:05 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:15:05 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:15:05 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:15:05 user devstack@n-api.service[61424]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:15:05 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:15:05 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:15:05 user devstack@n-api.service[61424]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:15:05 user devstack@n-api.service[61424]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:15:05 user devstack@n-api.service[61424]: method: > Apr 11 17:15:05 user devstack@n-api.service[61424]: exception: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61424]: action_args: {'id': '821c0f5c-2011-443d-9455-49cc9e317e33'} Apr 11 17:15:05 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:15:05 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-17f9f92b-a32d-4283-8ca0-f4850d6d3bb8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33" status: 404 len: 111 microversion: 2.1 time: 0.037626 Apr 11 17:15:05 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 209/618] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:15:05 2023] GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:15:05 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:05 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:05 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:15:05 user devstack@n-api.service[61423]: request: DELETE /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 HTTP/1.1 Apr 11 17:15:05 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:15:05 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:15:05 user devstack@n-api.service[61423]: Connection: close Apr 11 17:15:05 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:15:05 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:15:05 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:15:05 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:15:05 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:15:05 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:15:05 user devstack@n-api.service[61423]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:15:05 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:15:05 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:15:05 user devstack@n-api.service[61423]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:15:05 user devstack@n-api.service[61423]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:15:05 user devstack@n-api.service[61423]: method: > Apr 11 17:15:05 user devstack@n-api.service[61423]: exception: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61423]: action_args: {'id': '821c0f5c-2011-443d-9455-49cc9e317e33'} Apr 11 17:15:05 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:15:05 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-88420e3a-2637-4bc9-af61-d4f699680f9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33" status: 404 len: 111 microversion: 2.1 time: 0.028050 Apr 11 17:15:05 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 205/619] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:15:05 2023] DELETE /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:15:05 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:05 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 821c0f5c-2011-443d-9455-49cc9e317e33] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:15:05 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 HTTP/1.1 Apr 11 17:15:05 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:15:05 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:15:05 user devstack@n-api.service[61422]: Connection: close Apr 11 17:15:05 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:15:05 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:15:05 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:15:05 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:15:05 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:15:05 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:15:05 user devstack@n-api.service[61422]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:15:05 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:15:05 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:15:05 user devstack@n-api.service[61422]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:15:05 user devstack@n-api.service[61422]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:15:05 user devstack@n-api.service[61422]: method: > Apr 11 17:15:05 user devstack@n-api.service[61422]: exception: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61422]: action_args: {'id': '821c0f5c-2011-443d-9455-49cc9e317e33'} Apr 11 17:15:05 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. Apr 11 17:15:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:15:05 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance 821c0f5c-2011-443d-9455-49cc9e317e33 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:15:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-daf1154c-256c-43db-be24-d673e944d60d tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33" status: 404 len: 111 microversion: 2.1 time: 0.031322 Apr 11 17:15:05 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 206/620] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:15:05 2023] GET /compute/v2.1/servers/821c0f5c-2011-443d-9455-49cc9e317e33 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1599483328", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "2e99e75c-34b5-4135-a5c1-8037e24e601c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e"}]}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG nova.network.neutron [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] validate_networks() for [('dd04c0b8-1ba3-450d-9eab-fd88096ba41e', None, None, None, None, None)] {{(pid=61424) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:15:09 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-aa0449e3-8772-42de-bf5f-3580cea26b97 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1885198427", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "destination_type": "local"}, {"source_type": "volume", "uuid": "47826c37-838c-4f62-bae1-6d4bd10b7035", "destination_type": "invalid"}], "networks": [{"uuid": "fc5f2351-9e4e-4481-9745-87fe310d86e2"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:09 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-aa0449e3-8772-42de-bf5f-3580cea26b97 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Request method failure captured: Apr 11 17:15:09 user devstack@n-api.service[61423]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 17:15:09 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:15:09 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:15:09 user devstack@n-api.service[61423]: Connection: close Apr 11 17:15:09 user devstack@n-api.service[61423]: Content-Length: 494 Apr 11 17:15:09 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:15:09 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:15:09 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:15:09 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZPU2p5bCkmg0x_Q9dIkdqgqytm9uHgC0um1qHTWCne6uVxRI3BdOhhPkg5QR_fOQQ9oexwVC4ZHJDY8YKipla0AMDPwiudTG5ukXQAAeFNYD8oeBChIFNMN8C-svM_Bzq767kTUfH6aX8e1gtuLuIafyXlkukj6atCYDbKZV2bsmck Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Project-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Project-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}] Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Tenant: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Tenant-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:15:09 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:15:09 user devstack@n-api.service[61423]: X-User: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:15:09 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:15:09 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:15:09 user devstack@n-api.service[61423]: X-User-Id: d0c53186c18940aba415e0b999cbc2a0 Apr 11 17:15:09 user devstack@n-api.service[61423]: X-User-Name: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:15:09 user devstack@n-api.service[61423]: Apr 11 17:15:09 user devstack@n-api.service[61423]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1885198427", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "destination_type": "local"}, {"source_type": "volume", "uuid": "47826c37-838c-4f62-bae1-6d4bd10b7035", "destination_type": "invalid"}], "networks": [{"uuid": "fc5f2351-9e4e-4481-9745-87fe310d86e2"}]}} Apr 11 17:15:09 user devstack@n-api.service[61423]: method: > Apr 11 17:15:09 user devstack@n-api.service[61423]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 17:15:09 user devstack@n-api.service[61423]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1885198427', 'imageRef': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'ead60aec-ecbe-42c9-a205-fb6fdd4aef73', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '47826c37-838c-4f62-bae1-6d4bd10b7035', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'fc5f2351-9e4e-4481-9745-87fe310d86e2'}]}}} Apr 11 17:15:09 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise error Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi 'invalid' Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 17:15:09 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:15:09 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-aa0449e3-8772-42de-bf5f-3580cea26b97 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:15:09 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-aa0449e3-8772-42de-bf5f-3580cea26b97 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.012973 Apr 11 17:15:09 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 206/621] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:15:09 2023] POST /compute/v2.1/servers => generated 155 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:15:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-47c0b7fa-4a38-45c1-9ac5-a83cad93d37d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:09 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-47c0b7fa-4a38-45c1-9ac5-a83cad93d37d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-47c0b7fa-4a38-45c1-9ac5-a83cad93d37d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-47c0b7fa-4a38-45c1-9ac5-a83cad93d37d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-47c0b7fa-4a38-45c1-9ac5-a83cad93d37d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-47c0b7fa-4a38-45c1-9ac5-a83cad93d37d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-47c0b7fa-4a38-45c1-9ac5-a83cad93d37d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-47c0b7fa-4a38-45c1-9ac5-a83cad93d37d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:09 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-47c0b7fa-4a38-45c1-9ac5-a83cad93d37d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-47c0b7fa-4a38-45c1-9ac5-a83cad93d37d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705" status: 200 len: 1493 microversion: 2.1 time: 0.142917 Apr 11 17:15:09 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 207/622] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:15:09 2023] GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705 => generated 1493 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for user c7dcfe84c23f4c0aa80b8f287f0ab004 and project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Going to run 1 instances... {{(pid=61424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:15:09 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e99e75c-34b5-4135-a5c1-8037e24e601c',volume_size=None,volume_type=None)] {{(pid=61424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:15:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-5515500e-ba90-47c8-afe7-defe61985b9a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.694635 Apr 11 17:15:10 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 210/623] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:15:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:15:10 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-37e2c1e1-3ead-4e0f-b6dd-e31a3a6d9a11 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-37e2c1e1-3ead-4e0f-b6dd-e31a3a6d9a11 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:10 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-37e2c1e1-3ead-4e0f-b6dd-e31a3a6d9a11 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-37e2c1e1-3ead-4e0f-b6dd-e31a3a6d9a11 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7" status: 200 len: 1066 microversion: 2.1 time: 0.068684 Apr 11 17:15:10 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 207/624] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:15:10 2023] GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7 => generated 1066 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:15:12 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df974dc8-deda-4bdb-bb9d-1471bee040a7", "tag": "11a50593-74fe-4bfd-adc1-15e1537afc66"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] Creating event network-changed:11a50593-74fe-4bfd-adc1-15e1537afc66 for instance df974dc8-deda-4bdb-bb9d-1471bee040a7 on user Apr 11 17:15:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-05ff8d1d-2da1-45ec-8d54-23569b057809 req-7d21f29c-1361-4b95-ad7e-409d7e11d541 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036266 Apr 11 17:15:12 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 208/625] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:15:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:19 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df974dc8-deda-4bdb-bb9d-1471bee040a7", "name": "network-vif-plugged", "status": "completed", "tag": "11a50593-74fe-4bfd-adc1-15e1537afc66"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:19 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] Creating event network-vif-plugged:11a50593-74fe-4bfd-adc1-15e1537afc66 for instance df974dc8-deda-4bdb-bb9d-1471bee040a7 on user Apr 11 17:15:19 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-83bf5ab5-e623-4a05-9dcd-706eb0b33271 req-77f02ac9-d81b-422d-8d1b-d32f52cd51c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038991 Apr 11 17:15:19 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 211/626] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:15:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:21 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df974dc8-deda-4bdb-bb9d-1471bee040a7", "name": "network-vif-plugged", "status": "completed", "tag": "11a50593-74fe-4bfd-adc1-15e1537afc66"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:21 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:21 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:21 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:21 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] Creating event network-vif-plugged:11a50593-74fe-4bfd-adc1-15e1537afc66 for instance df974dc8-deda-4bdb-bb9d-1471bee040a7 on user Apr 11 17:15:21 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-5255116d-e63e-4b5b-9e84-bdcd15ac73a7 req-a1c7e5a6-7443-4916-aaa0-5a07aa12c9bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057650 Apr 11 17:15:21 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 208/627] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:15:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=8 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=12 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:27 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:27 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c2456b1f-18a8-46af-97f6-7c180c8256d8 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2" status: 200 len: 1587 microversion: 2.20 time: 0.148689 Apr 11 17:15:27 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 209/628] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:15:27 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 => generated 1587 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc while it is in vm_state rescued Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Request method failure captured: Apr 11 17:15:28 user devstack@n-api.service[61424]: request: DELETE /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-volume_attachments/c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 HTTP/1.1 Apr 11 17:15:28 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:15:28 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:15:28 user devstack@n-api.service[61424]: Connection: close Apr 11 17:15:28 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:15:28 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:15:28 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:15:28 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:15:28 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZLG_8768-mQu9yCs4bl3OD1M7pFG45ape6z4ER5iPMh2_4MVeL8_JC_PQr_wQldSevDB4n3fAHGtPfGRkhDLtbmOK0lOZKqOM-mism8v_CCvVElUL8QJRBymW1T6rq6VlnL9Bw8r7y3LHYzyoUDFyNZbhaisWcl1Vc1hXgwyF33jcU Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Project-Id: 16e55c9209ac4b11b5af5ec1ad14d8b5 Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}] Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Tenant-Id: 16e55c9209ac4b11b5af5ec1ad14d8b5 Apr 11 17:15:28 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:15:28 user devstack@n-api.service[61424]: X-User: tempest-ServerRescueNegativeTestJSON-1553918933-project-member Apr 11 17:15:28 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:15:28 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:15:28 user devstack@n-api.service[61424]: X-User-Id: 3666d19053684843b400aab6ebf29cce Apr 11 17:15:28 user devstack@n-api.service[61424]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1553918933-project-member Apr 11 17:15:28 user devstack@n-api.service[61424]: method: > Apr 11 17:15:28 user devstack@n-api.service[61424]: exception: Cannot 'detach_volume' instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc while it is in vm_state rescued Apr 11 17:15:28 user devstack@n-api.service[61424]: action_args: {'server_id': '9e213b9c-23c4-4fe4-bd2f-2443ee3628bc', 'id': 'c1f959e0-9f24-4e52-b2d6-b756bc69d2e6'} Apr 11 17:15:28 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc while it is in vm_state rescued Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc while it is in vm_state rescued Apr 11 17:15:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:15:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Returning 409 to user: Cannot 'detach_volume' instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc while it is in vm_state rescued {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:15:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-e746a884-e951-4aa9-ad4f-c7dcc214aa15 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-volume_attachments/c1f959e0-9f24-4e52-b2d6-b756bc69d2e6" status: 409 len: 152 microversion: 2.1 time: 0.114645 Apr 11 17:15:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 212/629] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:15:28 2023] DELETE /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-volume_attachments/c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 17:15:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:28 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-abeb029d-4f0c-416b-932a-94c35f3a8411 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/action" status: 202 len: 0 microversion: 2.1 time: 0.076162 Apr 11 17:15:28 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 209/630] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:15:28 2023] POST /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:15:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-787014c9-0140-409d-9b49-c8a6270988fe tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:28 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-787014c9-0140-409d-9b49-c8a6270988fe tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-787014c9-0140-409d-9b49-c8a6270988fe tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-787014c9-0140-409d-9b49-c8a6270988fe tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-787014c9-0140-409d-9b49-c8a6270988fe tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-787014c9-0140-409d-9b49-c8a6270988fe tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-787014c9-0140-409d-9b49-c8a6270988fe tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-787014c9-0140-409d-9b49-c8a6270988fe tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:28 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-787014c9-0140-409d-9b49-c8a6270988fe tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-787014c9-0140-409d-9b49-c8a6270988fe tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" status: 200 len: 1709 microversion: 2.1 time: 0.147355 Apr 11 17:15:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 210/631] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:15:28 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => generated 1709 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:15:29 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-unplugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:29 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] Creating event network-vif-unplugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:15:29 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-f7beed20-6efa-49c8-b534-6aa6942a4082 req-bb92885e-b0bb-4271-af99-cbb07fd0d51c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034265 Apr 11 17:15:29 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 213/632] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:15:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-da2c0af8-5c91-46cc-9fd9-f9d624313e21 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:30 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-da2c0af8-5c91-46cc-9fd9-f9d624313e21 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da2c0af8-5c91-46cc-9fd9-f9d624313e21 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da2c0af8-5c91-46cc-9fd9-f9d624313e21 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da2c0af8-5c91-46cc-9fd9-f9d624313e21 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da2c0af8-5c91-46cc-9fd9-f9d624313e21 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da2c0af8-5c91-46cc-9fd9-f9d624313e21 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da2c0af8-5c91-46cc-9fd9-f9d624313e21 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-da2c0af8-5c91-46cc-9fd9-f9d624313e21 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.152966 Apr 11 17:15:30 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 210/633] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:15:30 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-interface => generated 283 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-plugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}, {"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-plugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771531ad-b1f4-486a-b70f-f46837df58b5", "tag": "468963af-7fdf-43f9-9be8-b1569345361e"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Creating event network-vif-plugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:15:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] Creating event network-vif-plugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:15:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-a2bd2548-ab07-4891-8158-c5dcff56e32f req-db37968d-b5bb-4c1c-ab64-6bcbad3531cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031160 Apr 11 17:15:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 211/634] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:15:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] Creating event network-changed:468963af-7fdf-43f9-9be8-b1569345361e for instance 771531ad-b1f4-486a-b70f-f46837df58b5 on user Apr 11 17:15:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-255a4303-15c7-4349-aaa2-a2181c2dca22 req-509231ae-9cd8-4e3c-887c-7983937e2d9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037143 Apr 11 17:15:31 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 214/635] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:15:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:31 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ac2dbfe9-2176-4593-b93b-2e03e6db7d5e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:31 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ac2dbfe9-2176-4593-b93b-2e03e6db7d5e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac2dbfe9-2176-4593-b93b-2e03e6db7d5e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac2dbfe9-2176-4593-b93b-2e03e6db7d5e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac2dbfe9-2176-4593-b93b-2e03e6db7d5e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac2dbfe9-2176-4593-b93b-2e03e6db7d5e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac2dbfe9-2176-4593-b93b-2e03e6db7d5e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac2dbfe9-2176-4593-b93b-2e03e6db7d5e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:31 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ac2dbfe9-2176-4593-b93b-2e03e6db7d5e tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/ips" status: 200 len: 105 microversion: 2.1 time: 0.041554 Apr 11 17:15:31 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 211/636] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 17:15:31 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/ips => generated 105 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:33 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7874ba15-ca2a-4c0d-a7b6-48e9b9202710 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "POST /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309528 Apr 11 17:15:33 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 212/637] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:15:33 2023] POST /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:33 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-plugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:33 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] Creating event network-vif-plugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:15:33 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-fcf1aaee-5212-4758-91bd-adbbff6118a4 req-ead62a18-b5b9-490d-b916-dc50053ef739 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034196 Apr 11 17:15:33 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 215/638] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:15:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:34 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:34 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:34 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:34 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:34 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:34 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-431e220a-b924-44bc-bf06-eb543f3b61b7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" status: 200 len: 1770 microversion: 2.87 time: 0.171618 Apr 11 17:15:34 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 212/639] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:15:34 2023] GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => generated 1770 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:15:39 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e78c1b2a-dfdf-4b16-81b2-cc6cbb765fda tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:39 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e78c1b2a-dfdf-4b16-81b2-cc6cbb765fda tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e78c1b2a-dfdf-4b16-81b2-cc6cbb765fda tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e78c1b2a-dfdf-4b16-81b2-cc6cbb765fda tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e78c1b2a-dfdf-4b16-81b2-cc6cbb765fda tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e78c1b2a-dfdf-4b16-81b2-cc6cbb765fda tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e78c1b2a-dfdf-4b16-81b2-cc6cbb765fda tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e78c1b2a-dfdf-4b16-81b2-cc6cbb765fda tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:39 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-e78c1b2a-dfdf-4b16-81b2-cc6cbb765fda tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e78c1b2a-dfdf-4b16-81b2-cc6cbb765fda tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1722 microversion: 2.1 time: 0.163610 Apr 11 17:15:39 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 213/640] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:15:39 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:15:39 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-df8cf8a0-35b3-4a33-b481-722d4620cfe8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:39 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-df8cf8a0-35b3-4a33-b481-722d4620cfe8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:39 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-df8cf8a0-35b3-4a33-b481-722d4620cfe8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-df8cf8a0-35b3-4a33-b481-722d4620cfe8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-df8cf8a0-35b3-4a33-b481-722d4620cfe8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-df8cf8a0-35b3-4a33-b481-722d4620cfe8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-df8cf8a0-35b3-4a33-b481-722d4620cfe8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-df8cf8a0-35b3-4a33-b481-722d4620cfe8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:39 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=19 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:39 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-df8cf8a0-35b3-4a33-b481-722d4620cfe8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-df8cf8a0-35b3-4a33-b481-722d4620cfe8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1722 microversion: 2.1 time: 0.212608 Apr 11 17:15:39 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 216/641] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:15:39 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:15:40 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-c8a45504-cee4-48ec-93cb-2c9bfb021918 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:40 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-c8a45504-cee4-48ec-93cb-2c9bfb021918 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c8a45504-cee4-48ec-93cb-2c9bfb021918 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c8a45504-cee4-48ec-93cb-2c9bfb021918 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c8a45504-cee4-48ec-93cb-2c9bfb021918 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c8a45504-cee4-48ec-93cb-2c9bfb021918 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c8a45504-cee4-48ec-93cb-2c9bfb021918 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c8a45504-cee4-48ec-93cb-2c9bfb021918 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:40 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-c8a45504-cee4-48ec-93cb-2c9bfb021918 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Apr 11 17:15:40 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 213/642] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:15:40 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4a668577-30b9-42ae-897e-0bfc65b06193 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:40 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-4a668577-30b9-42ae-897e-0bfc65b06193 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4a668577-30b9-42ae-897e-0bfc65b06193 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4a668577-30b9-42ae-897e-0bfc65b06193 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4a668577-30b9-42ae-897e-0bfc65b06193 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4a668577-30b9-42ae-897e-0bfc65b06193 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4a668577-30b9-42ae-897e-0bfc65b06193 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4a668577-30b9-42ae-897e-0bfc65b06193 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-4a668577-30b9-42ae-897e-0bfc65b06193 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments/40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9" status: 200 len: 194 microversion: 2.1 time: 0.038236 Apr 11 17:15:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 214/643] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 17:15:40 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments/40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 => generated 194 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:42 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "454a12d7-9043-46e0-96ba-e6aaa9a47fef"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:42 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c7e34701-b749-40af-9356-023962f101e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "POST /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283560 Apr 11 17:15:42 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 217/644] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:15:42 2023] POST /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:49 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-c9cb038c-9fc3-421d-b2d4-78b813deb0e4 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:49 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-c9cb038c-9fc3-421d-b2d4-78b813deb0e4 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c9cb038c-9fc3-421d-b2d4-78b813deb0e4 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c9cb038c-9fc3-421d-b2d4-78b813deb0e4 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c9cb038c-9fc3-421d-b2d4-78b813deb0e4 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c9cb038c-9fc3-421d-b2d4-78b813deb0e4 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c9cb038c-9fc3-421d-b2d4-78b813deb0e4 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c9cb038c-9fc3-421d-b2d4-78b813deb0e4 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:49 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-c9cb038c-9fc3-421d-b2d4-78b813deb0e4 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050107 Apr 11 17:15:49 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 214/645] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:15:49 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:49 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-99f87ee6-4ece-4b7c-ac32-2e7121ace307 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:49 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-99f87ee6-4ece-4b7c-ac32-2e7121ace307 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99f87ee6-4ece-4b7c-ac32-2e7121ace307 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99f87ee6-4ece-4b7c-ac32-2e7121ace307 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99f87ee6-4ece-4b7c-ac32-2e7121ace307 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99f87ee6-4ece-4b7c-ac32-2e7121ace307 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99f87ee6-4ece-4b7c-ac32-2e7121ace307 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-99f87ee6-4ece-4b7c-ac32-2e7121ace307 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:49 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-99f87ee6-4ece-4b7c-ac32-2e7121ace307 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments/40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9" status: 200 len: 194 microversion: 2.1 time: 0.042527 Apr 11 17:15:49 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 215/646] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 17:15:49 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments/40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:49 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:49 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:49 user devstack@n-api.service[61424]: DEBUG nova.objects.instance [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'services' on Instance uuid 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=61424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:15:49 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ebf870d4-e25d-45e2-8e62-bc54f39e73e0 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments/40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9" status: 202 len: 0 microversion: 2.1 time: 0.182153 Apr 11 17:15:49 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 218/647] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:15:49 2023] DELETE /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments/40fb3cd1-ad51-4aa1-b7f8-04b8e1851dc9 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:15:51 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-833d7006-42aa-4ede-aabb-7b925a7ddd85 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:51 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-833d7006-42aa-4ede-aabb-7b925a7ddd85 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:51 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=17 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-833d7006-42aa-4ede-aabb-7b925a7ddd85 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-833d7006-42aa-4ede-aabb-7b925a7ddd85 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-833d7006-42aa-4ede-aabb-7b925a7ddd85 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-833d7006-42aa-4ede-aabb-7b925a7ddd85 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-833d7006-42aa-4ede-aabb-7b925a7ddd85 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-833d7006-42aa-4ede-aabb-7b925a7ddd85 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:51 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:15:51 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-833d7006-42aa-4ede-aabb-7b925a7ddd85 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments/454a12d7-9043-46e0-96ba-e6aaa9a47fef" status: 200 len: 194 microversion: 2.1 time: 0.045527 Apr 11 17:15:51 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 215/648] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 17:15:51 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments/454a12d7-9043-46e0-96ba-e6aaa9a47fef => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:51 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:51 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:51 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lazy-loading 'services' on Instance uuid 771531ad-b1f4-486a-b70f-f46837df58b5 {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:15:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3162d98f-dffb-4434-9ca1-69e901643d9f tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments/454a12d7-9043-46e0-96ba-e6aaa9a47fef" status: 202 len: 0 microversion: 2.1 time: 0.196974 Apr 11 17:15:52 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 216/649] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:15:51 2023] DELETE /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments/454a12d7-9043-46e0-96ba-e6aaa9a47fef => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f3132e8c-8a9f-4cc8-be6a-8af38eb0e8c8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f3132e8c-8a9f-4cc8-be6a-8af38eb0e8c8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f3132e8c-8a9f-4cc8-be6a-8af38eb0e8c8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f3132e8c-8a9f-4cc8-be6a-8af38eb0e8c8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f3132e8c-8a9f-4cc8-be6a-8af38eb0e8c8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f3132e8c-8a9f-4cc8-be6a-8af38eb0e8c8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f3132e8c-8a9f-4cc8-be6a-8af38eb0e8c8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f3132e8c-8a9f-4cc8-be6a-8af38eb0e8c8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:54 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f3132e8c-8a9f-4cc8-be6a-8af38eb0e8c8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043328 Apr 11 17:15:54 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 219/650] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:15:54 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-14982ef2-e197-4508-9635-f7524e6217e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-14982ef2-e197-4508-9635-f7524e6217e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-14982ef2-e197-4508-9635-f7524e6217e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-14982ef2-e197-4508-9635-f7524e6217e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-14982ef2-e197-4508-9635-f7524e6217e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-14982ef2-e197-4508-9635-f7524e6217e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-14982ef2-e197-4508-9635-f7524e6217e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-14982ef2-e197-4508-9635-f7524e6217e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-14982ef2-e197-4508-9635-f7524e6217e8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041583 Apr 11 17:15:54 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 216/651] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:15:54 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:15:54 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:54 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:54 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:15:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b0f7179a-4dac-4775-a24d-a51d30584fdd tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5" status: 204 len: 0 microversion: 2.1 time: 0.117216 Apr 11 17:15:54 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 217/652] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:15:54 2023] DELETE /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-b5de220d-55a7-49f3-a7d7-0a4f1db5eeed tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-b5de220d-55a7-49f3-a7d7-0a4f1db5eeed tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b5de220d-55a7-49f3-a7d7-0a4f1db5eeed tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b5de220d-55a7-49f3-a7d7-0a4f1db5eeed tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b5de220d-55a7-49f3-a7d7-0a4f1db5eeed tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b5de220d-55a7-49f3-a7d7-0a4f1db5eeed tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b5de220d-55a7-49f3-a7d7-0a4f1db5eeed tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b5de220d-55a7-49f3-a7d7-0a4f1db5eeed tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:54 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-b5de220d-55a7-49f3-a7d7-0a4f1db5eeed tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0109eab2dc45fe824a03e2d09fa022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c902eb30be24cc6bd26c0ab7036d037', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:15:54 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-b5de220d-55a7-49f3-a7d7-0a4f1db5eeed tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5" status: 200 len: 1662 microversion: 2.1 time: 0.197764 Apr 11 17:15:54 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 220/653] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:15:54 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5 => generated 1662 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771531ad-b1f4-486a-b70f-f46837df58b5", "name": "network-vif-unplugged", "status": "completed", "tag": "468963af-7fdf-43f9-9be8-b1569345361e"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] Creating event network-vif-unplugged:468963af-7fdf-43f9-9be8-b1569345361e for instance 771531ad-b1f4-486a-b70f-f46837df58b5 on user Apr 11 17:15:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-4cecddca-11d1-4dc2-a1cd-ce686ffe6917 req-44612669-aa85-45c2-9224-f63543e7cf6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032984 Apr 11 17:15:54 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 217/654] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:15:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:56 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-90ecfb7f-000b-4adc-9808-280c68152667 req-2ae8fd71-2b5c-4b23-a28d-a75ce2625c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771531ad-b1f4-486a-b70f-f46837df58b5", "name": "network-vif-deleted", "tag": "468963af-7fdf-43f9-9be8-b1569345361e"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-90ecfb7f-000b-4adc-9808-280c68152667 req-2ae8fd71-2b5c-4b23-a28d-a75ce2625c19 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-90ecfb7f-000b-4adc-9808-280c68152667 req-2ae8fd71-2b5c-4b23-a28d-a75ce2625c19 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-90ecfb7f-000b-4adc-9808-280c68152667 req-2ae8fd71-2b5c-4b23-a28d-a75ce2625c19 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-90ecfb7f-000b-4adc-9808-280c68152667 req-2ae8fd71-2b5c-4b23-a28d-a75ce2625c19 service nova] Creating event network-vif-deleted:468963af-7fdf-43f9-9be8-b1569345361e for instance 771531ad-b1f4-486a-b70f-f46837df58b5 on user Apr 11 17:15:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-90ecfb7f-000b-4adc-9808-280c68152667 req-2ae8fd71-2b5c-4b23-a28d-a75ce2625c19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029132 Apr 11 17:15:56 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 218/655] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:15:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:15:56 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771531ad-b1f4-486a-b70f-f46837df58b5", "name": "network-vif-plugged", "status": "completed", "tag": "468963af-7fdf-43f9-9be8-b1569345361e"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:15:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:15:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:15:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:15:57 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] Creating event network-vif-plugged:468963af-7fdf-43f9-9be8-b1569345361e for instance 771531ad-b1f4-486a-b70f-f46837df58b5 on user Apr 11 17:15:57 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-e8b166e4-ee96-404a-8f58-1f68e876c537 req-011bd65f-add4-4ffc-9b90-68e1520800a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031293 Apr 11 17:15:57 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 221/656] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:15:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-7fb8f415-a205-489f-9d66-1eb12e4b3cac tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:00 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-7fb8f415-a205-489f-9d66-1eb12e4b3cac tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7fb8f415-a205-489f-9d66-1eb12e4b3cac tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7fb8f415-a205-489f-9d66-1eb12e4b3cac tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7fb8f415-a205-489f-9d66-1eb12e4b3cac tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7fb8f415-a205-489f-9d66-1eb12e4b3cac tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7fb8f415-a205-489f-9d66-1eb12e4b3cac tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7fb8f415-a205-489f-9d66-1eb12e4b3cac tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:00 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-7fb8f415-a205-489f-9d66-1eb12e4b3cac tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:16:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-7fb8f415-a205-489f-9d66-1eb12e4b3cac tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7" status: 200 len: 1392 microversion: 2.1 time: 0.162619 Apr 11 17:16:00 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 218/657] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:16:00 2023] GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] HTTP exception thrown: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Request method failure captured: Apr 11 17:16:12 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c HTTP/1.1 Apr 11 17:16:12 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:16:12 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:16:12 user devstack@n-api.service[61422]: Connection: close Apr 11 17:16:12 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:16:12 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:16:12 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:16:12 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:16:12 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZPU2p5bCkmg0x_Q9dIkdqgqytm9uHgC0um1qHTWCne6uVxRI3BdOhhPkg5QR_fOQQ9oexwVC4ZHJDY8YKipla0AMDPwiudTG5ukXQAAeFNYD8oeBChIFNMN8C-svM_Bzq767kTUfH6aX8e1gtuLuIafyXlkukj6atCYDbKZV2bsmck Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Project-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}] Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Tenant: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Tenant-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:16:12 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:16:12 user devstack@n-api.service[61422]: X-User: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:16:12 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:16:12 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:16:12 user devstack@n-api.service[61422]: X-User-Id: d0c53186c18940aba415e0b999cbc2a0 Apr 11 17:16:12 user devstack@n-api.service[61422]: X-User-Name: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:16:12 user devstack@n-api.service[61422]: method: > Apr 11 17:16:12 user devstack@n-api.service[61422]: exception: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:16:12 user devstack@n-api.service[61422]: action_args: {'id': '351fca73-83de-49b4-91d8-72e3cf45a59c'} Apr 11 17:16:12 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:16:12 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Returning 404 to user: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:16:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-928ebbc5-a72d-4e6e-8529-a9bfe245056d tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c" status: 404 len: 111 microversion: 2.1 time: 0.035902 Apr 11 17:16:12 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 219/658] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:16:12 2023] DELETE /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=11 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: 351fca73-83de-49b4-91d8-72e3cf45a59c] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] HTTP exception thrown: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Request method failure captured: Apr 11 17:16:12 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c HTTP/1.1 Apr 11 17:16:12 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:16:12 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:16:12 user devstack@n-api.service[61424]: Connection: close Apr 11 17:16:12 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:16:12 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:16:12 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:16:12 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:16:12 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZPU2p5bCkmg0x_Q9dIkdqgqytm9uHgC0um1qHTWCne6uVxRI3BdOhhPkg5QR_fOQQ9oexwVC4ZHJDY8YKipla0AMDPwiudTG5ukXQAAeFNYD8oeBChIFNMN8C-svM_Bzq767kTUfH6aX8e1gtuLuIafyXlkukj6atCYDbKZV2bsmck Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Project-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Project-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}] Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Tenant: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Tenant-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:16:12 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:16:12 user devstack@n-api.service[61424]: X-User: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:16:12 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:16:12 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:16:12 user devstack@n-api.service[61424]: X-User-Id: d0c53186c18940aba415e0b999cbc2a0 Apr 11 17:16:12 user devstack@n-api.service[61424]: X-User-Name: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:16:12 user devstack@n-api.service[61424]: method: > Apr 11 17:16:12 user devstack@n-api.service[61424]: exception: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:16:12 user devstack@n-api.service[61424]: action_args: {'id': '351fca73-83de-49b4-91d8-72e3cf45a59c'} Apr 11 17:16:12 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. Apr 11 17:16:12 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Returning 404 to user: Instance 351fca73-83de-49b4-91d8-72e3cf45a59c could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:16:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-26ab660a-38df-44da-9f66-a88615e40a0e tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c" status: 404 len: 111 microversion: 2.1 time: 0.051282 Apr 11 17:16:12 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 222/659] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:16:12 2023] GET /compute/v2.1/servers/351fca73-83de-49b4-91d8-72e3cf45a59c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:16:12 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:12 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:12 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=7 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:12 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=19 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:12 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:16:12 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-7d2c48c3-d0be-4253-8d50-99f232a3caf2 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705" status: 204 len: 0 microversion: 2.1 time: 0.123327 Apr 11 17:16:12 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 219/660] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:16:12 2023] DELETE /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4f863679-02ae-4667-948a-ea6b2d16c51b tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-4f863679-02ae-4667-948a-ea6b2d16c51b tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4f863679-02ae-4667-948a-ea6b2d16c51b tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4f863679-02ae-4667-948a-ea6b2d16c51b tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4f863679-02ae-4667-948a-ea6b2d16c51b tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4f863679-02ae-4667-948a-ea6b2d16c51b tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4f863679-02ae-4667-948a-ea6b2d16c51b tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4f863679-02ae-4667-948a-ea6b2d16c51b tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:12 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-4f863679-02ae-4667-948a-ea6b2d16c51b tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0c53186c18940aba415e0b999cbc2a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1c61fd594564317a51c9dadebbba6c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:16:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-4f863679-02ae-4667-948a-ea6b2d16c51b tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705" status: 200 len: 1499 microversion: 2.1 time: 0.211012 Apr 11 17:16:12 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 220/661] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:16:12 2023] GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705 => generated 1499 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:16:13 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5bb4495-9a2d-4903-8158-c57b78e43705", "name": "network-vif-unplugged", "status": "completed", "tag": "15355548-ee2d-4cc0-abd1-44a292fa87dc"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:13 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] Creating event network-vif-unplugged:15355548-ee2d-4cc0-abd1-44a292fa87dc for instance c5bb4495-9a2d-4903-8158-c57b78e43705 on user Apr 11 17:16:13 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-9ad0b9ed-b3b4-49a8-a361-4c80b9ea4dcf req-2acfebca-3420-4146-abcc-e94afc6edd6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029994 Apr 11 17:16:13 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 223/662] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:15 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5bb4495-9a2d-4903-8158-c57b78e43705", "name": "network-vif-plugged", "status": "completed", "tag": "15355548-ee2d-4cc0-abd1-44a292fa87dc"}, {"server_uuid": "c5bb4495-9a2d-4903-8158-c57b78e43705", "name": "network-vif-deleted", "tag": "15355548-ee2d-4cc0-abd1-44a292fa87dc"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:15 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:15 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:15 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:15 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] Creating event network-vif-plugged:15355548-ee2d-4cc0-abd1-44a292fa87dc for instance c5bb4495-9a2d-4903-8158-c57b78e43705 on user Apr 11 17:16:15 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] Creating event network-vif-deleted:15355548-ee2d-4cc0-abd1-44a292fa87dc for instance c5bb4495-9a2d-4903-8158-c57b78e43705 on user Apr 11 17:16:15 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-a4756699-a91b-4438-8230-69d97ca4a32b req-6b1b5714-56e2-4e1c-9cf7-75e3b2f9358c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028347 Apr 11 17:16:15 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 220/663] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:19 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f6682e77-b9cd-436d-99df-6216d372a65a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:19 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-f6682e77-b9cd-436d-99df-6216d372a65a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f6682e77-b9cd-436d-99df-6216d372a65a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f6682e77-b9cd-436d-99df-6216d372a65a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f6682e77-b9cd-436d-99df-6216d372a65a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f6682e77-b9cd-436d-99df-6216d372a65a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f6682e77-b9cd-436d-99df-6216d372a65a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f6682e77-b9cd-436d-99df-6216d372a65a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:19 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-f6682e77-b9cd-436d-99df-6216d372a65a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:16:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-f6682e77-b9cd-436d-99df-6216d372a65a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" status: 200 len: 1715 microversion: 2.1 time: 0.148329 Apr 11 17:16:19 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 221/664] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:16:19 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:16:27 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-94d994ab-839a-4813-86b6-106495494fe7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:27 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-94d994ab-839a-4813-86b6-106495494fe7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:27 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=4 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:27 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=4 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-94d994ab-839a-4813-86b6-106495494fe7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-94d994ab-839a-4813-86b6-106495494fe7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-94d994ab-839a-4813-86b6-106495494fe7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-94d994ab-839a-4813-86b6-106495494fe7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-94d994ab-839a-4813-86b6-106495494fe7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-94d994ab-839a-4813-86b6-106495494fe7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-94d994ab-839a-4813-86b6-106495494fe7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.103483 Apr 11 17:16:27 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 224/665] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 17:16:27 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-interface => generated 283 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:16:28 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:28 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] Creating event network-changed:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:16:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-881e6160-e842-4695-bbdf-3403bd9966a7 req-5129a0ff-db3c-417f-ba22-5b33980768b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038005 Apr 11 17:16:28 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 221/666] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5294d789-40f9-4d2f-9db7-f2891adb63b9 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:28 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-5294d789-40f9-4d2f-9db7-f2891adb63b9 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5294d789-40f9-4d2f-9db7-f2891adb63b9 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5294d789-40f9-4d2f-9db7-f2891adb63b9 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5294d789-40f9-4d2f-9db7-f2891adb63b9 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5294d789-40f9-4d2f-9db7-f2891adb63b9 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5294d789-40f9-4d2f-9db7-f2891adb63b9 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5294d789-40f9-4d2f-9db7-f2891adb63b9 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-5294d789-40f9-4d2f-9db7-f2891adb63b9 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/ips" status: 200 len: 111 microversion: 2.20 time: 0.035290 Apr 11 17:16:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 222/667] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 17:16:28 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/ips => generated 111 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:16:29 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:29 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:29 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:29 user devstack@n-api.service[61424]: DEBUG nova.objects.instance [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'flavor' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=61424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:16:30 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-974877d8-9dcb-48c0-aab7-e4b854314864 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/action" status: 202 len: 0 microversion: 2.20 time: 0.897281 Apr 11 17:16:30 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 225/668] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 17:16:29 2023] POST /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/action => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:16:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:30 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:31 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:16:31 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:16:31 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:16:31 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-15a5eddb-5622-471c-88d9-a3185b1a6124 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2" status: 200 len: 1712 microversion: 2.20 time: 0.217494 Apr 11 17:16:31 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 222/669] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:16:30 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 => generated 1712 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:16:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "name": "network-vif-unplugged", "status": "completed", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] Creating event network-vif-unplugged:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:16:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-0e764647-f859-46e0-98c8-df0f8bf35c74 req-5f9fa7f1-5181-4eda-8723-66a04e123aa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033489 Apr 11 17:16:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 223/670] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:33 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "name": "network-vif-plugged", "status": "completed", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:33 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:33 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] Creating event network-vif-plugged:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:16:33 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-f3058ade-1d88-4a5e-a96e-be834e2bc7f1 req-b0082071-178f-4892-a109-2eecadd1688d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034977 Apr 11 17:16:33 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 226/671] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "893b2f97-eeff-46ce-bac8-20a35139827e"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:35 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:35 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lazy-loading 'flavor' on Instance uuid 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:16:35 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2e614214-76af-4a50-bdbc-43dcc55bf9a2 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/action" status: 200 len: 29 microversion: 2.87 time: 0.364530 Apr 11 17:16:35 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 223/672] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 17:16:35 2023] POST /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/action => generated 29 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:16:35 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:35 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:35 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] Creating event network-changed:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:16:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-5d5689ea-e3d4-488d-a0d3-0f905e2e0da4 req-1edf714b-f033-4f5e-ad0f-b3c183cb1a49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034936 Apr 11 17:16:35 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 227/673] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:35 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:16:35 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:16:35 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:16:35 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-fb602eb9-0bdd-4b87-870e-9b5f3ee243da tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" status: 200 len: 1776 microversion: 2.87 time: 0.265672 Apr 11 17:16:35 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 224/674] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:16:35 2023] GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => generated 1776 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:16:36 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-unplugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:36 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] Creating event network-vif-unplugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:16:36 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-f5840c24-686e-4ff2-8490-032221dca8ce req-b3b0c685-f260-442e-9e03-ccfbb93fdd45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034874 Apr 11 17:16:36 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 224/675] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:38 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-plugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:38 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] Creating event network-vif-plugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:16:38 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-7a9663d2-d1c1-4d58-aed5-0d8f8acb8ccb req-550676c9-eca3-494b-90c0-9bdaf738aa73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033757 Apr 11 17:16:38 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 228/676] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:39 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:39 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:39 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:16:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e4d5843a-73db-4f8c-b714-91ec42e86cd3 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 204 len: 0 microversion: 2.1 time: 0.130830 Apr 11 17:16:39 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 225/677] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:16:39 2023] DELETE /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:16:39 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b251dfc1-8f9e-4a5c-b035-8ebca375d211 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:39 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-b251dfc1-8f9e-4a5c-b035-8ebca375d211 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b251dfc1-8f9e-4a5c-b035-8ebca375d211 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b251dfc1-8f9e-4a5c-b035-8ebca375d211 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b251dfc1-8f9e-4a5c-b035-8ebca375d211 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b251dfc1-8f9e-4a5c-b035-8ebca375d211 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b251dfc1-8f9e-4a5c-b035-8ebca375d211 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b251dfc1-8f9e-4a5c-b035-8ebca375d211 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:39 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-b251dfc1-8f9e-4a5c-b035-8ebca375d211 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:16:39 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-b251dfc1-8f9e-4a5c-b035-8ebca375d211 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 200 len: 1728 microversion: 2.1 time: 0.221981 Apr 11 17:16:39 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 225/678] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:16:39 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:16:39 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-unplugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] Creating event network-vif-unplugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:16:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-28b226c0-6b3e-4688-8672-94bfbc2739f4 req-33c8a2bd-e076-4e82-bf87-34b8869b27c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044589 Apr 11 17:16:39 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 229/679] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-plugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] Creating event network-vif-plugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:16:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-de651eee-5025-4eb3-b990-18b410810576 req-8b7899de-1ee2-49e8-b2f3-1c67367703c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030201 Apr 11 17:16:40 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 226/680] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:42 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-plugged", "status": "completed", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}, {"server_uuid": "1fc7677c-cbd9-48e7-be62-2210074bc87a", "name": "network-vif-deleted", "tag": "6b20a003-d501-4958-9c8c-567343698e97"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:42 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] Creating event network-vif-plugged:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:16:42 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] Creating event network-vif-deleted:6b20a003-d501-4958-9c8c-567343698e97 for instance 1fc7677c-cbd9-48e7-be62-2210074bc87a on user Apr 11 17:16:42 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-54effcef-793d-4baf-9d49-4d3e6d81311e req-467da353-96be-468e-8c5a-fa46af380b3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039365 Apr 11 17:16:42 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 226/681] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:42 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-plugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] Creating event network-vif-plugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:16:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-8dfeaec9-5964-42ff-a046-2827426ff643 req-2906c727-3fb0-48b5-9509-9a8654134921 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035621 Apr 11 17:16:42 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 230/682] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:16:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] HTTP exception thrown: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Request method failure captured: Apr 11 17:16:44 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5 HTTP/1.1 Apr 11 17:16:44 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:16:44 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:16:44 user devstack@n-api.service[61422]: Connection: close Apr 11 17:16:44 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:16:44 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:16:44 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:16:44 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:16:44 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLN4vXvHRPKKWDW-ECm5G6uEioG308kpFEqrgJPleriLUll5XZ040XKXQaSBKStHyg2-xIpLQ0BCmtB27xgjjJTcCPN38-KW8ExTMPs7FPMY6El7X0KNM1_glwVcXpRd7Y188tCn5vB_LI_SwS5AQw4GeEnTI7GCoLMd5Zw-_lInLI Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Project-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}] Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Tenant-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:16:44 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:44 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:16:44 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:16:44 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:16:44 user devstack@n-api.service[61422]: X-User-Id: ac0109eab2dc45fe824a03e2d09fa022 Apr 11 17:16:44 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:16:44 user devstack@n-api.service[61422]: method: > Apr 11 17:16:44 user devstack@n-api.service[61422]: exception: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:44 user devstack@n-api.service[61422]: action_args: {'id': '771531ad-b1f4-486a-b70f-f46837df58b5'} Apr 11 17:16:44 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:44 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:44 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Returning 404 to user: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:16:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-1c79e9f8-9256-4d18-ac0b-54c4765cebb2 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5" status: 404 len: 111 microversion: 2.1 time: 0.035517 Apr 11 17:16:44 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 227/683] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:16:44 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:16:44 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-93529721-bc8a-496c-91e5-4be810b270d9 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '.version_select at 0x7f5bdd7d3f40>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:44 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-93529721-bc8a-496c-91e5-4be810b270d9 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520901621" status: 202 len: 0 microversion: 2.1 time: 0.026380 Apr 11 17:16:44 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 227/684] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 17:16:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520901621 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:16:48 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:48 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:48 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] HTTP exception thrown: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:48 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Request method failure captured: Apr 11 17:16:48 user devstack@n-api.service[61424]: request: DELETE /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5 HTTP/1.1 Apr 11 17:16:48 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:16:48 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:16:48 user devstack@n-api.service[61424]: Connection: close Apr 11 17:16:48 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:16:48 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:16:48 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:16:48 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:16:48 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZLN4vXvHRPKKWDW-ECm5G6uEioG308kpFEqrgJPleriLUll5XZ040XKXQaSBKStHyg2-xIpLQ0BCmtB27xgjjJTcCPN38-KW8ExTMPs7FPMY6El7X0KNM1_glwVcXpRd7Y188tCn5vB_LI_SwS5AQw4GeEnTI7GCoLMd5Zw-_lInLI Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Project-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Project-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}] Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Tenant: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Tenant-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:16:48 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:48 user devstack@n-api.service[61424]: X-User: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:16:48 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:16:48 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:16:48 user devstack@n-api.service[61424]: X-User-Id: ac0109eab2dc45fe824a03e2d09fa022 Apr 11 17:16:48 user devstack@n-api.service[61424]: X-User-Name: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:16:48 user devstack@n-api.service[61424]: method: > Apr 11 17:16:48 user devstack@n-api.service[61424]: exception: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:48 user devstack@n-api.service[61424]: action_args: {'id': '771531ad-b1f4-486a-b70f-f46837df58b5'} Apr 11 17:16:48 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:48 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:48 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Returning 404 to user: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:16:48 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-aa0ec2f9-037d-4ff0-b2b7-a62a4e0ab698 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5" status: 404 len: 111 microversion: 2.1 time: 0.034013 Apr 11 17:16:48 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 231/685] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:16:48 2023] DELETE /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:16:48 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:48 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: 771531ad-b1f4-486a-b70f-f46837df58b5] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] HTTP exception thrown: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:48 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Request method failure captured: Apr 11 17:16:48 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5 HTTP/1.1 Apr 11 17:16:48 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:16:48 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:16:48 user devstack@n-api.service[61422]: Connection: close Apr 11 17:16:48 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:16:48 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:16:48 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:16:48 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:16:48 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLN4vXvHRPKKWDW-ECm5G6uEioG308kpFEqrgJPleriLUll5XZ040XKXQaSBKStHyg2-xIpLQ0BCmtB27xgjjJTcCPN38-KW8ExTMPs7FPMY6El7X0KNM1_glwVcXpRd7Y188tCn5vB_LI_SwS5AQw4GeEnTI7GCoLMd5Zw-_lInLI Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Project-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}] Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Tenant-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:16:48 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:48 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:16:48 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:16:48 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:16:48 user devstack@n-api.service[61422]: X-User-Id: ac0109eab2dc45fe824a03e2d09fa022 Apr 11 17:16:48 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:16:48 user devstack@n-api.service[61422]: method: > Apr 11 17:16:48 user devstack@n-api.service[61422]: exception: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:48 user devstack@n-api.service[61422]: action_args: {'id': '771531ad-b1f4-486a-b70f-f46837df58b5'} Apr 11 17:16:48 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. Apr 11 17:16:48 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:16:48 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Returning 404 to user: Instance 771531ad-b1f4-486a-b70f-f46837df58b5 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:16:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-740075f3-3743-4e5a-9da0-8e118e7e03a8 tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5" status: 404 len: 111 microversion: 2.1 time: 0.029868 Apr 11 17:16:48 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 228/686] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:16:48 2023] GET /compute/v2.1/servers/771531ad-b1f4-486a-b70f-f46837df58b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:16:49 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:49 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:49 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] HTTP exception thrown: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:16:49 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Request method failure captured: Apr 11 17:16:49 user devstack@n-api.service[61423]: request: DELETE /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 HTTP/1.1 Apr 11 17:16:49 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:16:49 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:16:49 user devstack@n-api.service[61423]: Connection: close Apr 11 17:16:49 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:16:49 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:16:49 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:16:49 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:16:49 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLN4vXvHRPKKWDW-ECm5G6uEioG308kpFEqrgJPleriLUll5XZ040XKXQaSBKStHyg2-xIpLQ0BCmtB27xgjjJTcCPN38-KW8ExTMPs7FPMY6El7X0KNM1_glwVcXpRd7Y188tCn5vB_LI_SwS5AQw4GeEnTI7GCoLMd5Zw-_lInLI Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Project-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Project-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}] Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Tenant: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Tenant-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:16:49 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:49 user devstack@n-api.service[61423]: X-User: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:16:49 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:16:49 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:16:49 user devstack@n-api.service[61423]: X-User-Id: ac0109eab2dc45fe824a03e2d09fa022 Apr 11 17:16:49 user devstack@n-api.service[61423]: X-User-Name: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:16:49 user devstack@n-api.service[61423]: method: > Apr 11 17:16:49 user devstack@n-api.service[61423]: exception: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:16:49 user devstack@n-api.service[61423]: action_args: {'id': 'd9cb0b86-5d7d-4d78-a6a0-632cebb4cc32'} Apr 11 17:16:49 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:16:49 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:49 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Returning 404 to user: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:16:49 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e6919e6b-4593-48d3-84ba-831aa9edd47d tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 404 len: 111 microversion: 2.1 time: 0.032080 Apr 11 17:16:49 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 228/687] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:16:49 2023] DELETE /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:16:49 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:49 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] [instance: d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:16:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:16:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:16:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:16:49 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] HTTP exception thrown: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:16:49 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Request method failure captured: Apr 11 17:16:49 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 HTTP/1.1 Apr 11 17:16:49 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:16:49 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:16:49 user devstack@n-api.service[61424]: Connection: close Apr 11 17:16:49 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:16:49 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:16:49 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:16:49 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:16:49 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZLN4vXvHRPKKWDW-ECm5G6uEioG308kpFEqrgJPleriLUll5XZ040XKXQaSBKStHyg2-xIpLQ0BCmtB27xgjjJTcCPN38-KW8ExTMPs7FPMY6El7X0KNM1_glwVcXpRd7Y188tCn5vB_LI_SwS5AQw4GeEnTI7GCoLMd5Zw-_lInLI Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Project-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Project-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3c902eb30be24cc6bd26c0ab7036d037"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3c902eb30be24cc6bd26c0ab7036d037"}]}] Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Tenant: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Tenant-Id: 3c902eb30be24cc6bd26c0ab7036d037 Apr 11 17:16:49 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1071232138 Apr 11 17:16:49 user devstack@n-api.service[61424]: X-User: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:16:49 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:16:49 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:16:49 user devstack@n-api.service[61424]: X-User-Id: ac0109eab2dc45fe824a03e2d09fa022 Apr 11 17:16:49 user devstack@n-api.service[61424]: X-User-Name: tempest-AttachVolumeTestJSON-1071232138-project-member Apr 11 17:16:49 user devstack@n-api.service[61424]: method: > Apr 11 17:16:49 user devstack@n-api.service[61424]: exception: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:16:49 user devstack@n-api.service[61424]: action_args: {'id': 'd9cb0b86-5d7d-4d78-a6a0-632cebb4cc32'} Apr 11 17:16:49 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. Apr 11 17:16:49 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:16:49 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] Returning 404 to user: Instance d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:16:49 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-1c529cbf-7b00-4046-8e24-7aa65f53102b tempest-AttachVolumeTestJSON-1071232138 tempest-AttachVolumeTestJSON-1071232138-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32" status: 404 len: 111 microversion: 2.1 time: 0.031102 Apr 11 17:16:49 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 232/688] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:16:49 2023] GET /compute/v2.1/servers/d9cb0b86-5d7d-4d78-a6a0-632cebb4cc32 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:16:54 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-0dcb915d-e709-4be1-b64e-6e2bee114f31 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd6f5120>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-820672844"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-0dcb915d-e709-4be1-b64e-6e2bee114f31 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.569184 Apr 11 17:16:54 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 229/689] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 11 17:16:54 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 571 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 17:16:55 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-780905de-b2e9-451a-9130-e8968b737ef4 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd7d3490>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:55 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-780905de-b2e9-451a-9130-e8968b737ef4 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c" status: 200 len: 344 microversion: 2.1 time: 0.065309 Apr 11 17:16:55 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 229/690] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:16:54 2023] GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:56 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c01b1434-7b6d-4994-9d6a-5359d7b6b977 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd87bc70>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:56 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c01b1434-7b6d-4994-9d6a-5359d7b6b977 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c" status: 200 len: 345 microversion: 2.1 time: 0.055706 Apr 11 17:16:56 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 233/691] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:16:56 2023] GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:56 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-24c0ae31-70a0-4c3f-a63e-8530d27aa051 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd7323b0>, body: {"snapshot": {"volume_id": "6018934e-2a51-4887-81f8-72afb770b99c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1211019376"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:16:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-24c0ae31-70a0-4c3f-a63e-8530d27aa051 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.324256 Apr 11 17:16:56 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 230/692] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Apr 11 17:16:56 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:56 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-cfef0774-6c10-411f-84f1-eaf95e13ee78 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd681750>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:56 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-cfef0774-6c10-411f-84f1-eaf95e13ee78 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62" status: 200 len: 287 microversion: 2.1 time: 0.039913 Apr 11 17:16:56 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 230/693] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 17:16:56 2023] GET /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:56 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ca13f409-f187-4e20-9a01-fdafa544644c tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd8e3f40>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:56 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ca13f409-f187-4e20-9a01-fdafa544644c tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.050578 Apr 11 17:16:56 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 234/694] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 17:16:56 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:56 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d948bff0-d937-41db-b689-fbf52e5828cb tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd6f7ac0>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d948bff0-d937-41db-b689-fbf52e5828cb tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62" status: 200 len: 287 microversion: 2.1 time: 0.035653 Apr 11 17:16:56 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 231/695] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 17:16:56 2023] GET /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:57 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-0623bdef-964e-4929-820f-67e6adf1274c tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd7d3490>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:57 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-0623bdef-964e-4929-820f-67e6adf1274c tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62" status: 200 len: 288 microversion: 2.1 time: 0.033819 Apr 11 17:16:57 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 231/696] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 17:16:57 2023] GET /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62 => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:57 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-22222080-b37d-43ff-8487-439989978e68 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd87b6d0>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:57 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-22222080-b37d-43ff-8487-439989978e68 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62" status: 202 len: 0 microversion: 2.1 time: 0.065341 Apr 11 17:16:57 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 235/697] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 17:16:57 2023] DELETE /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:16:57 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ad8a7b10-e1aa-48fa-af5e-e56ea5351a56 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd6f5240>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ad8a7b10-e1aa-48fa-af5e-e56ea5351a56 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62" status: 200 len: 287 microversion: 2.1 time: 0.033073 Apr 11 17:16:57 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 232/698] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 17:16:57 2023] GET /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:58 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-71fd1b0b-dc1d-4455-87ca-aaa406ad4fc4 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd680ca0>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:58 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-71fd1b0b-dc1d-4455-87ca-aaa406ad4fc4 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] HTTP exception thrown: Snapshot c39da3fb-8ba0-403d-998f-82b47b3e3f62 could not be found. Apr 11 17:16:58 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-71fd1b0b-dc1d-4455-87ca-aaa406ad4fc4 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Request method failure captured: Apr 11 17:16:58 user devstack@n-api.service[61423]: request: GET /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62 HTTP/1.1 Apr 11 17:16:58 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:16:58 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:16:58 user devstack@n-api.service[61423]: Connection: close Apr 11 17:16:58 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:16:58 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:16:58 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:16:58 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:16:58 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZYG7rdvTb0cf79jNiJcIL-IubmVuG6qY_mglMqEk0TqHFhFriU0YvOPXWHn0xt57Hz7lERZ_seGELdE5PcKprj765zdhUr_huieryU-LmJis3gITt2Jq1m0myooXl_z0CrHftdGXg-q06q9EPDMxcoTmnzflbIydCfV-Z406fiYF8w Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Project-Id: f5e0bc098acc462abc17d016f447e9a1 Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f5e0bc098acc462abc17d016f447e9a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f5e0bc098acc462abc17d016f447e9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f5e0bc098acc462abc17d016f447e9a1"}]}] Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Tenant: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Tenant-Id: f5e0bc098acc462abc17d016f447e9a1 Apr 11 17:16:58 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:16:58 user devstack@n-api.service[61423]: X-User: tempest-VolumesSnapshotsTestJSON-585426410-project-member Apr 11 17:16:58 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:16:58 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:16:58 user devstack@n-api.service[61423]: X-User-Id: 35812cf9e35342508b483cbf8be2d205 Apr 11 17:16:58 user devstack@n-api.service[61423]: X-User-Name: tempest-VolumesSnapshotsTestJSON-585426410-project-member Apr 11 17:16:58 user devstack@n-api.service[61423]: method: Apr 11 17:16:58 user devstack@n-api.service[61423]: exception: Snapshot c39da3fb-8ba0-403d-998f-82b47b3e3f62 could not be found. Apr 11 17:16:58 user devstack@n-api.service[61423]: action_args: {'id': 'c39da3fb-8ba0-403d-998f-82b47b3e3f62'} Apr 11 17:16:58 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c39da3fb-8ba0-403d-998f-82b47b3e3f62 could not be found. (HTTP 404) (Request-ID: req-8a037080-3871-41ea-9ef7-cf1c1967d3d4) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c39da3fb-8ba0-403d-998f-82b47b3e3f62 could not be found. Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c39da3fb-8ba0-403d-998f-82b47b3e3f62 could not be found. Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c39da3fb-8ba0-403d-998f-82b47b3e3f62 could not be found. Apr 11 17:16:58 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:16:58 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-71fd1b0b-dc1d-4455-87ca-aaa406ad4fc4 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Returning 404 to user: Snapshot c39da3fb-8ba0-403d-998f-82b47b3e3f62 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:16:58 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-71fd1b0b-dc1d-4455-87ca-aaa406ad4fc4 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62" status: 404 len: 111 microversion: 2.1 time: 0.038221 Apr 11 17:16:58 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 232/699] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 17:16:58 2023] GET /compute/v2.1/os-snapshots/c39da3fb-8ba0-403d-998f-82b47b3e3f62 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:16:58 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-5096cb82-a85e-446a-98ca-8898ab29ba3a tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd8e3e20>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:58 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-5096cb82-a85e-446a-98ca-8898ab29ba3a tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c" status: 202 len: 0 microversion: 2.1 time: 0.066170 Apr 11 17:16:58 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 236/700] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 17:16:58 2023] DELETE /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:16:58 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:58 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:58 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8dc4dfcb-0ac8-4b6a-9d3a-b9ed918618f9 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd6f71c0>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:16:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8dc4dfcb-0ac8-4b6a-9d3a-b9ed918618f9 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c" status: 200 len: 344 microversion: 2.1 time: 0.054929 Apr 11 17:16:58 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 233/701] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:16:58 2023] GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:16:59 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:59 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:16:59 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f99cb588-f9f4-4684-8b09-bd6963fd2253 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd6801f0>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-f99cb588-f9f4-4684-8b09-bd6963fd2253 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] HTTP exception thrown: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f99cb588-f9f4-4684-8b09-bd6963fd2253 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Request method failure captured: Apr 11 17:17:00 user devstack@n-api.service[61423]: request: GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c HTTP/1.1 Apr 11 17:17:00 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:17:00 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:17:00 user devstack@n-api.service[61423]: Connection: close Apr 11 17:17:00 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:17:00 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:17:00 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:17:00 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:17:00 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZYG7rdvTb0cf79jNiJcIL-IubmVuG6qY_mglMqEk0TqHFhFriU0YvOPXWHn0xt57Hz7lERZ_seGELdE5PcKprj765zdhUr_huieryU-LmJis3gITt2Jq1m0myooXl_z0CrHftdGXg-q06q9EPDMxcoTmnzflbIydCfV-Z406fiYF8w Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Project-Id: f5e0bc098acc462abc17d016f447e9a1 Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f5e0bc098acc462abc17d016f447e9a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f5e0bc098acc462abc17d016f447e9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f5e0bc098acc462abc17d016f447e9a1"}]}] Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Tenant: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Tenant-Id: f5e0bc098acc462abc17d016f447e9a1 Apr 11 17:17:00 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:17:00 user devstack@n-api.service[61423]: X-User: tempest-VolumesSnapshotsTestJSON-585426410-project-member Apr 11 17:17:00 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:17:00 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:17:00 user devstack@n-api.service[61423]: X-User-Id: 35812cf9e35342508b483cbf8be2d205 Apr 11 17:17:00 user devstack@n-api.service[61423]: X-User-Name: tempest-VolumesSnapshotsTestJSON-585426410-project-member Apr 11 17:17:00 user devstack@n-api.service[61423]: method: Apr 11 17:17:00 user devstack@n-api.service[61423]: exception: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61423]: action_args: {'id': '6018934e-2a51-4887-81f8-72afb770b99c'} Apr 11 17:17:00 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. (HTTP 404) (Request-ID: req-68f7a1bc-e538-45b8-ad7e-6e0b31c70246) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f99cb588-f9f4-4684-8b09-bd6963fd2253 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Returning 404 to user: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:17:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f99cb588-f9f4-4684-8b09-bd6963fd2253 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c" status: 404 len: 109 microversion: 2.1 time: 0.047197 Apr 11 17:17:00 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 233/702] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:16:59 2023] GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=18 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f74975bc-970f-4f01-9e79-f680d94218f7 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd879120>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:00 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-f74975bc-970f-4f01-9e79-f680d94218f7 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] HTTP exception thrown: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f74975bc-970f-4f01-9e79-f680d94218f7 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Request method failure captured: Apr 11 17:17:00 user devstack@n-api.service[61424]: request: DELETE /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c HTTP/1.1 Apr 11 17:17:00 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:17:00 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:17:00 user devstack@n-api.service[61424]: Connection: close Apr 11 17:17:00 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:17:00 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:17:00 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:17:00 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:17:00 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZYG7rdvTb0cf79jNiJcIL-IubmVuG6qY_mglMqEk0TqHFhFriU0YvOPXWHn0xt57Hz7lERZ_seGELdE5PcKprj765zdhUr_huieryU-LmJis3gITt2Jq1m0myooXl_z0CrHftdGXg-q06q9EPDMxcoTmnzflbIydCfV-Z406fiYF8w Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Project-Id: f5e0bc098acc462abc17d016f447e9a1 Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f5e0bc098acc462abc17d016f447e9a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f5e0bc098acc462abc17d016f447e9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f5e0bc098acc462abc17d016f447e9a1"}]}] Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Tenant: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Tenant-Id: f5e0bc098acc462abc17d016f447e9a1 Apr 11 17:17:00 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:17:00 user devstack@n-api.service[61424]: X-User: tempest-VolumesSnapshotsTestJSON-585426410-project-member Apr 11 17:17:00 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:17:00 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:17:00 user devstack@n-api.service[61424]: X-User-Id: 35812cf9e35342508b483cbf8be2d205 Apr 11 17:17:00 user devstack@n-api.service[61424]: X-User-Name: tempest-VolumesSnapshotsTestJSON-585426410-project-member Apr 11 17:17:00 user devstack@n-api.service[61424]: method: Apr 11 17:17:00 user devstack@n-api.service[61424]: exception: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61424]: action_args: {'id': '6018934e-2a51-4887-81f8-72afb770b99c'} Apr 11 17:17:00 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. (HTTP 404) (Request-ID: req-59039cb3-af66-41e0-a87e-03b712cc0de7) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f74975bc-970f-4f01-9e79-f680d94218f7 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Returning 404 to user: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:17:00 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f74975bc-970f-4f01-9e79-f680d94218f7 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c" status: 404 len: 109 microversion: 2.1 time: 0.080181 Apr 11 17:17:00 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 237/703] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 17:17:00 2023] DELETE /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:17:00 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-87b740d8-445a-46b4-a3bf-ef74684ea0b6 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Calling method '.version_select at 0x7f5bdd6f65f0>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:00 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-87b740d8-445a-46b4-a3bf-ef74684ea0b6 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] HTTP exception thrown: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-87b740d8-445a-46b4-a3bf-ef74684ea0b6 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Request method failure captured: Apr 11 17:17:00 user devstack@n-api.service[61422]: request: GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c HTTP/1.1 Apr 11 17:17:00 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:17:00 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:17:00 user devstack@n-api.service[61422]: Connection: close Apr 11 17:17:00 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:17:00 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:17:00 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:17:00 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:17:00 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZYG7rdvTb0cf79jNiJcIL-IubmVuG6qY_mglMqEk0TqHFhFriU0YvOPXWHn0xt57Hz7lERZ_seGELdE5PcKprj765zdhUr_huieryU-LmJis3gITt2Jq1m0myooXl_z0CrHftdGXg-q06q9EPDMxcoTmnzflbIydCfV-Z406fiYF8w Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Project-Id: f5e0bc098acc462abc17d016f447e9a1 Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f5e0bc098acc462abc17d016f447e9a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f5e0bc098acc462abc17d016f447e9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f5e0bc098acc462abc17d016f447e9a1"}]}] Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Tenant: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Tenant-Id: f5e0bc098acc462abc17d016f447e9a1 Apr 11 17:17:00 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-585426410 Apr 11 17:17:00 user devstack@n-api.service[61422]: X-User: tempest-VolumesSnapshotsTestJSON-585426410-project-member Apr 11 17:17:00 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:17:00 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:17:00 user devstack@n-api.service[61422]: X-User-Id: 35812cf9e35342508b483cbf8be2d205 Apr 11 17:17:00 user devstack@n-api.service[61422]: X-User-Name: tempest-VolumesSnapshotsTestJSON-585426410-project-member Apr 11 17:17:00 user devstack@n-api.service[61422]: method: Apr 11 17:17:00 user devstack@n-api.service[61422]: exception: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61422]: action_args: {'id': '6018934e-2a51-4887-81f8-72afb770b99c'} Apr 11 17:17:00 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. (HTTP 404) (Request-ID: req-06453820-19ba-4628-a83b-ae1a81a9c748) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. Apr 11 17:17:00 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:00 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-87b740d8-445a-46b4-a3bf-ef74684ea0b6 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] Returning 404 to user: Volume 6018934e-2a51-4887-81f8-72afb770b99c could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:17:00 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-87b740d8-445a-46b4-a3bf-ef74684ea0b6 tempest-VolumesSnapshotsTestJSON-585426410 tempest-VolumesSnapshotsTestJSON-585426410-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c" status: 404 len: 109 microversion: 2.1 time: 0.074556 Apr 11 17:17:00 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 234/704] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 17:17:00 2023] GET /compute/v2.1/os-volumes/6018934e-2a51-4887-81f8-72afb770b99c => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:17:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ae1c13b7-32e4-4504-8bb8-53033a006a71 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:00 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ae1c13b7-32e4-4504-8bb8-53033a006a71 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae1c13b7-32e4-4504-8bb8-53033a006a71 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae1c13b7-32e4-4504-8bb8-53033a006a71 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae1c13b7-32e4-4504-8bb8-53033a006a71 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae1c13b7-32e4-4504-8bb8-53033a006a71 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae1c13b7-32e4-4504-8bb8-53033a006a71 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae1c13b7-32e4-4504-8bb8-53033a006a71 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:00 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ae1c13b7-32e4-4504-8bb8-53033a006a71 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ae1c13b7-32e4-4504-8bb8-53033a006a71 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7" status: 200 len: 1392 microversion: 2.1 time: 0.177638 Apr 11 17:17:00 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 234/705] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:17:00 2023] GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1281409480"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:00 user devstack@n-api.service[61424]: INFO nova.compute.api [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Attempting to quiesce instance before volume snapshot. Apr 11 17:17:00 user devstack@n-api.service[61424]: INFO nova.compute.api [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 11 17:17:00 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Creating snapshot from volume 2e99e75c-34b5-4135-a5c1-8037e24e601c. {{(pid=61424) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 11 17:17:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:02 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] [instance: c5bb4495-9a2d-4903-8158-c57b78e43705] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] HTTP exception thrown: Instance c5bb4495-9a2d-4903-8158-c57b78e43705 could not be found. Apr 11 17:17:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Request method failure captured: Apr 11 17:17:02 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705 HTTP/1.1 Apr 11 17:17:02 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:17:02 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:17:02 user devstack@n-api.service[61422]: Connection: close Apr 11 17:17:02 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:17:02 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:17:02 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:17:02 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:17:02 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZPU2p5bCkmg0x_Q9dIkdqgqytm9uHgC0um1qHTWCne6uVxRI3BdOhhPkg5QR_fOQQ9oexwVC4ZHJDY8YKipla0AMDPwiudTG5ukXQAAeFNYD8oeBChIFNMN8C-svM_Bzq767kTUfH6aX8e1gtuLuIafyXlkukj6atCYDbKZV2bsmck Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Project-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d1c61fd594564317a51c9dadebbba6c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d1c61fd594564317a51c9dadebbba6c7"}]}] Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Tenant: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Tenant-Id: d1c61fd594564317a51c9dadebbba6c7 Apr 11 17:17:02 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1657059206 Apr 11 17:17:02 user devstack@n-api.service[61422]: X-User: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:17:02 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:17:02 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:17:02 user devstack@n-api.service[61422]: X-User-Id: d0c53186c18940aba415e0b999cbc2a0 Apr 11 17:17:02 user devstack@n-api.service[61422]: X-User-Name: tempest-ServersNegativeTestJSON-1657059206-project-member Apr 11 17:17:02 user devstack@n-api.service[61422]: method: > Apr 11 17:17:02 user devstack@n-api.service[61422]: exception: Instance c5bb4495-9a2d-4903-8158-c57b78e43705 could not be found. Apr 11 17:17:02 user devstack@n-api.service[61422]: action_args: {'id': 'c5bb4495-9a2d-4903-8158-c57b78e43705'} Apr 11 17:17:02 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5bb4495-9a2d-4903-8158-c57b78e43705 could not be found. Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5bb4495-9a2d-4903-8158-c57b78e43705 could not be found. Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5bb4495-9a2d-4903-8158-c57b78e43705 could not be found. Apr 11 17:17:02 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] Returning 404 to user: Instance c5bb4495-9a2d-4903-8158-c57b78e43705 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:17:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3db81395-2c38-4f90-bda3-1c95ebebbd46 tempest-ServersNegativeTestJSON-1657059206 tempest-ServersNegativeTestJSON-1657059206-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705" status: 404 len: 111 microversion: 2.1 time: 0.029418 Apr 11 17:17:02 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 235/706] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:17:02 2023] GET /compute/v2.1/servers/c5bb4495-9a2d-4903-8158-c57b78e43705 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:17:03 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-dd7080c1-949d-4736-b544-b481b2ddca36 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "POST /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7/action" status: 202 len: 0 microversion: 2.1 time: 2.674259 Apr 11 17:17:03 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 238/707] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:17:00 2023] POST /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7/action => generated 0 bytes in 2678 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 17:17:03 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-526047112", "imageRef": "273f8606-84b3-45d3-b376-88cb98e870e6", "flavorRef": "42", "networks": [{"uuid": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:03 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] validate_networks() for [('dd04c0b8-1ba3-450d-9eab-fd88096ba41e', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for user c7dcfe84c23f4c0aa80b8f287f0ab004 and project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:17:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c7391171-35b0-4045-ba02-df762e8b6833',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:17:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-d89532b6-53db-428d-a4c9-c457a54547ca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.916529 Apr 11 17:17:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 235/708] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:17:03 2023] POST /compute/v2.1/servers => generated 378 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:17:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a2ff0c12-0f93-45fe-9272-337cfd41b76c tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:04 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a2ff0c12-0f93-45fe-9272-337cfd41b76c tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:04 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-a2ff0c12-0f93-45fe-9272-337cfd41b76c tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-a2ff0c12-0f93-45fe-9272-337cfd41b76c tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d" status: 200 len: 1223 microversion: 2.1 time: 0.104524 Apr 11 17:17:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 236/709] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:17:04 2023] GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:17:07 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b8cd04-945b-4926-b7fb-b6c65ed0164d", "tag": "ace52784-2fcb-440a-8ff5-4fa05c330f9b"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] Creating event network-changed:ace52784-2fcb-440a-8ff5-4fa05c330f9b for instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d on user Apr 11 17:17:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-bf25c747-934f-4c95-a823-0f8cbffd7f86 req-5f4f402d-1ca2-439c-8b4e-dc5735d61021 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033463 Apr 11 17:17:07 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 239/710] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:14 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:14 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:14 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:14 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:14 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-d629f313-a56f-40ae-b1f9-6117c4fc873d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd683ac0>, body: {"keypair": {"name": "tempest-keypair-1874843256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIiVZRIcFyrvGPDYWVH2yITtiQzaRj2SywIZW4J28+dHZ1qwOIi5RhBpem8WI1Pb6Gr2152T3472CaYxEgZeL4HFHRz9zhJhhcmnLlUaTw8qfm4gEhwuOe1dDzwWwz76g=="}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:14 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-d629f313-a56f-40ae-b1f9-6117c4fc873d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for project 23c663a759724bbda32f189ceedf6675. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:17:14 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-d629f313-a56f-40ae-b1f9-6117c4fc873d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for user ff27d08254f74491aba3386c9b901300 and project 23c663a759724bbda32f189ceedf6675. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:17:14 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-d629f313-a56f-40ae-b1f9-6117c4fc873d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179558 Apr 11 17:17:14 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 236/711] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:17:14 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-466344126", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2"}], "security_groups": [{"name": "tempest-securitygroup--1125868439"}], "key_name": "tempest-keypair-1874843256", "user_data": "}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] validate_networks() for [('f6d30218-0af4-4ce4-bb7e-990a43a37ec2', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for project 23c663a759724bbda32f189ceedf6675. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for user ff27d08254f74491aba3386c9b901300 and project 23c663a759724bbda32f189ceedf6675. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:17:16 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:17:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-f7e3b134-c05d-496b-82c0-fa5cd832e1a5 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.649953 Apr 11 17:17:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 237/712] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:17:16 2023] POST /compute/v2.1/servers => generated 400 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:17:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-8483918d-a0a6-4a0c-a3d9-666c95a7d77a tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:16 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-8483918d-a0a6-4a0c-a3d9-666c95a7d77a tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:16 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-8483918d-a0a6-4a0c-a3d9-666c95a7d77a tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-8483918d-a0a6-4a0c-a3d9-666c95a7d77a tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb" status: 200 len: 1235 microversion: 2.1 time: 0.098200 Apr 11 17:17:16 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 240/713] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:17:16 2023] GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb => generated 1235 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:17:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b8cd04-945b-4926-b7fb-b6c65ed0164d", "name": "network-vif-plugged", "status": "completed", "tag": "ace52784-2fcb-440a-8ff5-4fa05c330f9b"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:18 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] Creating event network-vif-plugged:ace52784-2fcb-440a-8ff5-4fa05c330f9b for instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d on user Apr 11 17:17:18 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-b7ea9920-a9be-4d34-bb48-dcf881eb9561 req-b29a874c-2761-42ff-aadf-54d7e83119f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042341 Apr 11 17:17:18 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 237/714] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:19 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e6f987ca-9370-49aa-ac40-6990f5942bcb tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:19 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e6f987ca-9370-49aa-ac40-6990f5942bcb tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e6f987ca-9370-49aa-ac40-6990f5942bcb tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e6f987ca-9370-49aa-ac40-6990f5942bcb tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e6f987ca-9370-49aa-ac40-6990f5942bcb tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e6f987ca-9370-49aa-ac40-6990f5942bcb tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e6f987ca-9370-49aa-ac40-6990f5942bcb tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e6f987ca-9370-49aa-ac40-6990f5942bcb tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e6f987ca-9370-49aa-ac40-6990f5942bcb tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.095565 Apr 11 17:17:19 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 238/715] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:17:19 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-interface => generated 282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:20 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:20 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:20 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=16,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:20 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:20 user devstack@n-api.service[61424]: DEBUG nova.objects.instance [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lazy-loading 'services' on Instance uuid 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc {{(pid=61424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:17:20 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-7b5499b7-51c2-4266-a49d-dc7bed00ba16 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-volume_attachments/c1f959e0-9f24-4e52-b2d6-b756bc69d2e6" status: 202 len: 0 microversion: 2.1 time: 0.204798 Apr 11 17:17:20 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 241/716] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:17:20 2023] DELETE /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-volume_attachments/c1f959e0-9f24-4e52-b2d6-b756bc69d2e6 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:17:20 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-9f0dd5c9-dc3d-40e9-b0a6-7473ecbfad0b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:20 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-9f0dd5c9-dc3d-40e9-b0a6-7473ecbfad0b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f0dd5c9-dc3d-40e9-b0a6-7473ecbfad0b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f0dd5c9-dc3d-40e9-b0a6-7473ecbfad0b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f0dd5c9-dc3d-40e9-b0a6-7473ecbfad0b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f0dd5c9-dc3d-40e9-b0a6-7473ecbfad0b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f0dd5c9-dc3d-40e9-b0a6-7473ecbfad0b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:20 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9f0dd5c9-dc3d-40e9-b0a6-7473ecbfad0b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:20 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b8cd04-945b-4926-b7fb-b6c65ed0164d", "name": "network-vif-plugged", "status": "completed", "tag": "ace52784-2fcb-440a-8ff5-4fa05c330f9b"}, {"name": "network-changed", "server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}, {"name": "network-changed", "server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-9f0dd5c9-dc3d-40e9-b0a6-7473ecbfad0b tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058310 Apr 11 17:17:20 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 238/717] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:17:20 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Creating event network-vif-plugged:ace52784-2fcb-440a-8ff5-4fa05c330f9b for instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d on user Apr 11 17:17:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Creating event network-changed:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:17:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] Creating event network-changed:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:17:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-a406d9e3-9e92-428b-95be-40e8be4b7d4f req-e060f5f2-a603-48d8-b8f1-81cb3476fc36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.053935 Apr 11 17:17:20 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 239/718] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:20 2023] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:21 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:21 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:21 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:21 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5f9fe94-98f0-4094-8003-53c06cbfd5cb", "tag": "4ec17eb0-1b20-4679-9900-3fa2850b50b8"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:21 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] Creating event network-changed:4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb on user Apr 11 17:17:21 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-64577f7b-b198-4cc8-9bb7-063c6b1ff2d9 req-7687d74a-77f2-49b9-90a2-b212e1cdc6e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102716 Apr 11 17:17:21 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 239/719] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:21 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:21 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:21 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:21 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-7df46712-cea9-4e38-8af1-82e5478c9096 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2" status: 200 len: 1653 microversion: 2.20 time: 0.381248 Apr 11 17:17:21 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 242/720] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:17:21 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 => generated 1653 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:17:24 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f9fe94-98f0-4094-8003-53c06cbfd5cb", "name": "network-vif-plugged", "status": "completed", "tag": "4ec17eb0-1b20-4679-9900-3fa2850b50b8"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:24 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] Creating event network-vif-plugged:4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb on user Apr 11 17:17:24 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5146cf4e-fa69-4a34-88ce-9e4dc7316be0 req-68c6702f-55e6-4255-887a-f7a6271c2c30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048959 Apr 11 17:17:24 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 240/721] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:25 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:25 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-aa9dbc41-b4c6-4c1d-b51e-5a7c1147d16a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" status: 200 len: 1756 microversion: 2.87 time: 0.168798 Apr 11 17:17:25 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 240/722] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:17:25 2023] GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:17:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f9fe94-98f0-4094-8003-53c06cbfd5cb", "name": "network-vif-plugged", "status": "completed", "tag": "4ec17eb0-1b20-4679-9900-3fa2850b50b8"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] Creating event network-vif-plugged:4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb on user Apr 11 17:17:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-657d26e0-3def-4ad7-9758-074357428726 req-869fc165-9f83-4a33-8e67-7c1a5cd39224 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032310 Apr 11 17:17:26 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 243/723] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:29 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:29 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:29 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HTTP exception thrown: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Request method failure captured: Apr 11 17:17:29 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a HTTP/1.1 Apr 11 17:17:29 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:17:29 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:17:29 user devstack@n-api.service[61422]: Connection: close Apr 11 17:17:29 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:17:29 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:17:29 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:17:29 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:17:29 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLGpirdpLMj_i7NmajlEExMFHxHhn207qLd6HDD9DGPXvMYZSXRyXSPGW2x2an54vs9P5g-3SjyYEOq7KG8BtE52dRs5qFDJCHgjHfrrvaa4ZwoqfQbMSDFZua72G9LhvghdNETCx2RnS9-0RFdD64DirN9EirvB4gv6s_wo7I8RDU Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Project-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}] Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Tenant: tempest-ServerActionsTestJSON-499420188 Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Tenant-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:17:29 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:17:29 user devstack@n-api.service[61422]: X-User: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:17:29 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:17:29 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:17:29 user devstack@n-api.service[61422]: X-User-Id: 8f4ba7d7f3f74b5c800be2408c1035e2 Apr 11 17:17:29 user devstack@n-api.service[61422]: X-User-Name: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:17:29 user devstack@n-api.service[61422]: method: > Apr 11 17:17:29 user devstack@n-api.service[61422]: exception: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:29 user devstack@n-api.service[61422]: action_args: {'id': '1fc7677c-cbd9-48e7-be62-2210074bc87a'} Apr 11 17:17:29 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:29 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:17:30 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:17:30 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:17:30 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:17:30 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:30 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:17:30 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Returning 404 to user: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:17:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-442cc5a6-10cf-4fa3-8874-7eedcc703eae tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 404 len: 111 microversion: 2.1 time: 0.059305 Apr 11 17:17:30 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 241/724] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:17:29 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:17:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:30 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HTTP exception thrown: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Request method failure captured: Apr 11 17:17:30 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments HTTP/1.1 Apr 11 17:17:30 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:17:30 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:17:30 user devstack@n-api.service[61423]: Connection: close Apr 11 17:17:30 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:17:30 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:17:30 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:17:30 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:17:30 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLGpirdpLMj_i7NmajlEExMFHxHhn207qLd6HDD9DGPXvMYZSXRyXSPGW2x2an54vs9P5g-3SjyYEOq7KG8BtE52dRs5qFDJCHgjHfrrvaa4ZwoqfQbMSDFZua72G9LhvghdNETCx2RnS9-0RFdD64DirN9EirvB4gv6s_wo7I8RDU Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Project-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Project-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}] Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Tenant: tempest-ServerActionsTestJSON-499420188 Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Tenant-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:17:30 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:17:30 user devstack@n-api.service[61423]: X-User: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:17:30 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:17:30 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:17:30 user devstack@n-api.service[61423]: X-User-Id: 8f4ba7d7f3f74b5c800be2408c1035e2 Apr 11 17:17:30 user devstack@n-api.service[61423]: X-User-Name: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:17:30 user devstack@n-api.service[61423]: method: > Apr 11 17:17:30 user devstack@n-api.service[61423]: exception: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:30 user devstack@n-api.service[61423]: action_args: {'server_id': '1fc7677c-cbd9-48e7-be62-2210074bc87a'} Apr 11 17:17:30 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:17:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Returning 404 to user: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:17:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f6e9907f-564c-4f6a-b140-035b2483c611 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035315 Apr 11 17:17:30 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 241/725] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:17:30 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=15 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:30 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HTTP exception thrown: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Request method failure captured: Apr 11 17:17:30 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a HTTP/1.1 Apr 11 17:17:30 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:17:30 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:17:30 user devstack@n-api.service[61424]: Connection: close Apr 11 17:17:30 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:17:30 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:17:30 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:17:30 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:17:30 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZLGpirdpLMj_i7NmajlEExMFHxHhn207qLd6HDD9DGPXvMYZSXRyXSPGW2x2an54vs9P5g-3SjyYEOq7KG8BtE52dRs5qFDJCHgjHfrrvaa4ZwoqfQbMSDFZua72G9LhvghdNETCx2RnS9-0RFdD64DirN9EirvB4gv6s_wo7I8RDU Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Project-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Project-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}] Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Tenant: tempest-ServerActionsTestJSON-499420188 Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Tenant-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:17:30 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:17:30 user devstack@n-api.service[61424]: X-User: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:17:30 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:17:30 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:17:30 user devstack@n-api.service[61424]: X-User-Id: 8f4ba7d7f3f74b5c800be2408c1035e2 Apr 11 17:17:30 user devstack@n-api.service[61424]: X-User-Name: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:17:30 user devstack@n-api.service[61424]: method: > Apr 11 17:17:30 user devstack@n-api.service[61424]: exception: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:30 user devstack@n-api.service[61424]: action_args: {'id': '1fc7677c-cbd9-48e7-be62-2210074bc87a'} Apr 11 17:17:30 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:17:30 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:17:30 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Returning 404 to user: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:17:30 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-2527d93a-33fa-47b1-a75c-33fd989fdb21 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 404 len: 111 microversion: 2.1 time: 0.052675 Apr 11 17:17:30 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 244/726] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:17:30 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:17:30 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1640703286", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "a3d41d47-6b37-4493-ac8f-572031c1a620"}], "security_groups": [{"name": "tempest-securitygroup--2090478013"}], "key_name": "tempest-keypair-1019962913", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:30 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] validate_networks() for [('a3d41d47-6b37-4493-ac8f-572031c1a620', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for project db242f5f39d94966948e8b487cd52d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for user 8f4ba7d7f3f74b5c800be2408c1035e2 and project db242f5f39d94966948e8b487cd52d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:17:31 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:17:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-55804215-8b45-452d-b5f1-a73db2724ada tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.302793 Apr 11 17:17:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 242/727] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:17:30 2023] POST /compute/v2.1/servers => generated 404 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:17:31 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a8dc7cd4-bf58-4e19-916a-962e4e625778 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:31 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-a8dc7cd4-bf58-4e19-916a-962e4e625778 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:31 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-a8dc7cd4-bf58-4e19-916a-962e4e625778 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:31 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-a8dc7cd4-bf58-4e19-916a-962e4e625778 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1" status: 200 len: 1233 microversion: 2.1 time: 0.112349 Apr 11 17:17:31 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 242/728] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:17:31 2023] GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1 => generated 1233 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:17:35 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a306a5-f981-495f-9f3a-8fd5011b4ce1", "tag": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] Creating event network-changed:2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 on user Apr 11 17:17:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-4b9b387e-0d48-4b12-aadc-f614836edbb2 req-fc509954-46bf-4dfc-85b8-19a2c079e63b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068604 Apr 11 17:17:35 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 245/729] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:35 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-74242352-d919-4c4c-bfde-3bf25ebf7207 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd6f48b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1224626118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLxa/ZHC1zg9o79buWgybrWNerDTs1d14b/0papPqydjJzDo3PFwFGt0tpGoOPy95T9Y8zJ6F9c3Eiq4Pn41IGbYq0ZbGsgyS8sqXZ4RS+8CByYS0fKJYJ4crZme94LRg=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:35 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-74242352-d919-4c4c-bfde-3bf25ebf7207 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting quotas for project ab7ce3fc251f4f1eb9151d1ef8c86d91. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:17:35 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-74242352-d919-4c4c-bfde-3bf25ebf7207 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting quotas for user eed61e2d73a84d85a9f5ff2b314624c9 and project ab7ce3fc251f4f1eb9151d1ef8c86d91. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:17:35 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-74242352-d919-4c4c-bfde-3bf25ebf7207 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058275 Apr 11 17:17:35 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 243/730] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:17:35 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-728641310", "imageRef": "f3215b4d-2cf9-4d8a-97ac-d18798f8f815", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1224626118", "networks": [{"uuid": "e8339c3d-c984-4d1a-b01d-b64e5aec1392"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:35 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] validate_networks() for [('e8339c3d-c984-4d1a-b01d-b64e5aec1392', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting quotas for project ab7ce3fc251f4f1eb9151d1ef8c86d91. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting quotas for user eed61e2d73a84d85a9f5ff2b314624c9 and project ab7ce3fc251f4f1eb9151d1ef8c86d91. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:17:36 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f3215b4d-2cf9-4d8a-97ac-d18798f8f815',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:17:36 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-be32d64c-8251-4611-b659-8c4cd0356a47 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.576744 Apr 11 17:17:36 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 243/731] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:17:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:17:36 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f4f9bbb5-664c-4f76-b623-06d6c0ee3228 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:36 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f4f9bbb5-664c-4f76-b623-06d6c0ee3228 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:36 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-f4f9bbb5-664c-4f76-b623-06d6c0ee3228 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:36 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f4f9bbb5-664c-4f76-b623-06d6c0ee3228 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6" status: 200 len: 1252 microversion: 2.1 time: 0.073519 Apr 11 17:17:36 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 246/732] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:17:36 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 => generated 1252 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:17:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a306a5-f981-495f-9f3a-8fd5011b4ce1", "name": "network-vif-plugged", "status": "completed", "tag": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] Creating event network-vif-plugged:2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 on user Apr 11 17:17:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-995c4dce-5ac4-431f-836a-090e6010b46e req-bd1cc6fc-5f83-409c-8627-bcec47639000 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053688 Apr 11 17:17:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 244/733] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:17:39 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a306a5-f981-495f-9f3a-8fd5011b4ce1", "name": "network-vif-plugged", "status": "completed", "tag": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:39 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] Creating event network-vif-plugged:2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 on user Apr 11 17:17:39 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-58b8a516-711f-4a2e-9173-ee57943a118a req-dc801eb4-c9d6-4840-9bdc-aa8d62ecc62b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030788 Apr 11 17:17:39 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 244/734] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:39 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] Creating event network-changed:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:17:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-26c6a06b-2fb4-4a59-b8fb-351d10a2bd81 req-98b84ca5-77a4-411f-9614-cf5122f0f267 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037981 Apr 11 17:17:39 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 247/735] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:41 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "name": "network-vif-plugged", "status": "completed", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] Creating event network-vif-plugged:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:17:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5003f2d1-14e7-44ef-be28-00fdde2e3d01 req-95fc77a7-6188-4b08-899e-e664bea1e816 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056707 Apr 11 17:17:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 245/736] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:43 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "name": "network-vif-plugged", "status": "completed", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:17:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] Creating event network-vif-plugged:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:17:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-1979afa2-3f1c-4b55-a03f-3adc6c6d3675 req-aab6ea2c-e350-4ab6-9760-289f0578d04f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032071 Apr 11 17:17:43 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 245/737] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:17:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=9 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-9d6e1e15-71fa-4c7f-9e6d-00dfe3bb6cd8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-9d6e1e15-71fa-4c7f-9e6d-00dfe3bb6cd8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d6e1e15-71fa-4c7f-9e6d-00dfe3bb6cd8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d6e1e15-71fa-4c7f-9e6d-00dfe3bb6cd8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d6e1e15-71fa-4c7f-9e6d-00dfe3bb6cd8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d6e1e15-71fa-4c7f-9e6d-00dfe3bb6cd8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d6e1e15-71fa-4c7f-9e6d-00dfe3bb6cd8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d6e1e15-71fa-4c7f-9e6d-00dfe3bb6cd8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:17:54 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-9d6e1e15-71fa-4c7f-9e6d-00dfe3bb6cd8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:17:54 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-9d6e1e15-71fa-4c7f-9e6d-00dfe3bb6cd8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d" status: 200 len: 1549 microversion: 2.1 time: 0.322985 Apr 11 17:17:54 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 248/738] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:17:54 2023] GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d => generated 1549 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=10 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=7 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=18 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c73667af-446e-4b13-b2c9-e0cf25bcafd0 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c73667af-446e-4b13-b2c9-e0cf25bcafd0 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c73667af-446e-4b13-b2c9-e0cf25bcafd0 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c73667af-446e-4b13-b2c9-e0cf25bcafd0 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c73667af-446e-4b13-b2c9-e0cf25bcafd0 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c73667af-446e-4b13-b2c9-e0cf25bcafd0 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c73667af-446e-4b13-b2c9-e0cf25bcafd0 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c73667af-446e-4b13-b2c9-e0cf25bcafd0 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:07 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-c73667af-446e-4b13-b2c9-e0cf25bcafd0 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c73667af-446e-4b13-b2c9-e0cf25bcafd0 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb" status: 200 len: 1545 microversion: 2.1 time: 0.155317 Apr 11 17:18:07 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 246/739] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:18:07 2023] GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb => generated 1545 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=24 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-074213c0-252f-44d2-b1a1-b18836886748 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-074213c0-252f-44d2-b1a1-b18836886748 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-074213c0-252f-44d2-b1a1-b18836886748 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-074213c0-252f-44d2-b1a1-b18836886748 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-074213c0-252f-44d2-b1a1-b18836886748 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-074213c0-252f-44d2-b1a1-b18836886748 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-074213c0-252f-44d2-b1a1-b18836886748 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-074213c0-252f-44d2-b1a1-b18836886748 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-074213c0-252f-44d2-b1a1-b18836886748 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051483 Apr 11 17:18:10 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 246/740] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:18:10 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:18:11 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:18:11 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:11 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:11 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:11 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:18:11 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-085ea2cd-0225-44dc-badd-b66533bca9f0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" status: 204 len: 0 microversion: 2.1 time: 0.132304 Apr 11 17:18:11 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 249/741] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:18:10 2023] DELETE /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:18:11 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b9c71a52-d450-4cf8-a48d-9ff6f4fbf0db tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:18:11 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-b9c71a52-d450-4cf8-a48d-9ff6f4fbf0db tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b9c71a52-d450-4cf8-a48d-9ff6f4fbf0db tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b9c71a52-d450-4cf8-a48d-9ff6f4fbf0db tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b9c71a52-d450-4cf8-a48d-9ff6f4fbf0db tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b9c71a52-d450-4cf8-a48d-9ff6f4fbf0db tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b9c71a52-d450-4cf8-a48d-9ff6f4fbf0db tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b9c71a52-d450-4cf8-a48d-9ff6f4fbf0db tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:11 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-b9c71a52-d450-4cf8-a48d-9ff6f4fbf0db tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b9c71a52-d450-4cf8-a48d-9ff6f4fbf0db tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" status: 200 len: 1675 microversion: 2.1 time: 0.264461 Apr 11 17:18:11 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 247/742] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:18:11 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => generated 1675 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:18:11 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-unplugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] Creating event network-vif-unplugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:18:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-625dd9af-a833-494d-81d8-31fc8dfda1dc req-87d0630b-f594-47fa-93d1-f49c763c0cfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030474 Apr 11 17:18:11 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 247/743] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:18:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-c0c63950-fe54-4750-8dc0-25acde1c6f34 req-b605a836-4f41-4b1a-a8d8-306cc8c858a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-deleted", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c0c63950-fe54-4750-8dc0-25acde1c6f34 req-b605a836-4f41-4b1a-a8d8-306cc8c858a0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c0c63950-fe54-4750-8dc0-25acde1c6f34 req-b605a836-4f41-4b1a-a8d8-306cc8c858a0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c0c63950-fe54-4750-8dc0-25acde1c6f34 req-b605a836-4f41-4b1a-a8d8-306cc8c858a0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-c0c63950-fe54-4750-8dc0-25acde1c6f34 req-b605a836-4f41-4b1a-a8d8-306cc8c858a0 service nova] Creating event network-vif-deleted:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:18:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-c0c63950-fe54-4750-8dc0-25acde1c6f34 req-b605a836-4f41-4b1a-a8d8-306cc8c858a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039733 Apr 11 17:18:12 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 250/744] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:18:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e213b9c-23c4-4fe4-bd2f-2443ee3628bc", "name": "network-vif-plugged", "status": "completed", "tag": "b9d61f36-ee8c-4487-81e1-28d27592a092"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] Creating event network-vif-plugged:b9d61f36-ee8c-4487-81e1-28d27592a092 for instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc on user Apr 11 17:18:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-38cea288-2fe7-483d-bacf-e69c7b9e683a req-ebae154f-f2e2-4c51-9baf-edbde55d41f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027450 Apr 11 17:18:13 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 248/745] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:18:21 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:21 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:21 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-62c5e518-3adb-4ff9-9a41-d9aa87566023 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:21 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-62c5e518-3adb-4ff9-9a41-d9aa87566023 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-62c5e518-3adb-4ff9-9a41-d9aa87566023 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-62c5e518-3adb-4ff9-9a41-d9aa87566023 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-62c5e518-3adb-4ff9-9a41-d9aa87566023 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-62c5e518-3adb-4ff9-9a41-d9aa87566023 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-62c5e518-3adb-4ff9-9a41-d9aa87566023 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:21 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-62c5e518-3adb-4ff9-9a41-d9aa87566023 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:21 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cb628957-ed06-4341-bff0-c85d6dc58ad8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:18:21 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-cb628957-ed06-4341-bff0-c85d6dc58ad8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:22 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-62c5e518-3adb-4ff9-9a41-d9aa87566023 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.412464 Apr 11 17:18:22 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 248/746] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 17:18:21 2023] POST /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-volume_attachments => generated 188 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:18:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb628957-ed06-4341-bff0-c85d6dc58ad8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb628957-ed06-4341-bff0-c85d6dc58ad8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb628957-ed06-4341-bff0-c85d6dc58ad8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb628957-ed06-4341-bff0-c85d6dc58ad8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb628957-ed06-4341-bff0-c85d6dc58ad8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb628957-ed06-4341-bff0-c85d6dc58ad8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:22 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:22 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:22 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61422) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 17:18:22 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-cb628957-ed06-4341-bff0-c85d6dc58ad8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-cb628957-ed06-4341-bff0-c85d6dc58ad8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1" status: 200 len: 1541 microversion: 2.1 time: 0.349157 Apr 11 17:18:22 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 251/747] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:18:21 2023] GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1 => generated 1541 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:18:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ddff201e-0e35-4c6d-b8ad-531baa75d509 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/action" status: 202 len: 0 microversion: 2.20 time: 0.139521 Apr 11 17:18:22 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 249/748] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 17:18:22 2023] POST /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:18:22 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:18:22 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:22 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:22 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:22 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:22 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-bea08b66-3f22-48e1-bb03-1405425d7f8a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2" status: 200 len: 1739 microversion: 2.20 time: 0.203587 Apr 11 17:18:22 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 249/749] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:18:22 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:18:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:26 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-51bce022-2075-4ec9-b89f-05e6f41e9c1c tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/action" status: 202 len: 0 microversion: 2.87 time: 0.092885 Apr 11 17:18:26 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 252/750] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 17:18:26 2023] POST /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:18:26 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:18:26 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:26 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:26 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:26 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-2b2de301-a368-4bc4-858a-eb453dee8b1d tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" status: 200 len: 1764 microversion: 2.87 time: 0.164279 Apr 11 17:18:26 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 250/751] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:18:26 2023] GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => generated 1764 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:18:26 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-9dd58001-c2cf-4e1f-99dc-b681efda9c80 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:18:26 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-9dd58001-c2cf-4e1f-99dc-b681efda9c80 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9dd58001-c2cf-4e1f-99dc-b681efda9c80 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9dd58001-c2cf-4e1f-99dc-b681efda9c80 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9dd58001-c2cf-4e1f-99dc-b681efda9c80 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9dd58001-c2cf-4e1f-99dc-b681efda9c80 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9dd58001-c2cf-4e1f-99dc-b681efda9c80 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9dd58001-c2cf-4e1f-99dc-b681efda9c80 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:26 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-9dd58001-c2cf-4e1f-99dc-b681efda9c80 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:26 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-9dd58001-c2cf-4e1f-99dc-b681efda9c80 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6" status: 200 len: 1536 microversion: 2.1 time: 0.174966 Apr 11 17:18:26 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 250/752] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:18:26 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 => generated 1536 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:18:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-unplugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] Creating event network-vif-unplugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:18:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-096c7c62-0f45-46aa-b90e-69f6b8b657da req-23ec3d72-4e26-4d18-b6c2-53ac72f71bc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049310 Apr 11 17:18:27 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 253/753] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:18:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-plugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}, {"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-plugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Creating event network-vif-plugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:18:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] Creating event network-vif-plugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:18:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-c43ccaf9-537b-4764-893e-8d90f77992fd req-bbaf8272-b1bd-466c-a01c-b982b1c6e823 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033125 Apr 11 17:18:29 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 251/754] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:18:29 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:29 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] Creating event network-changed:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:18:29 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-94ee94c7-b884-4767-9017-0bc5f8e4e142 req-ccc47ff0-e6a5-4747-9bff-b2455e21ba5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088861 Apr 11 17:18:29 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 251/755] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:18:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-plugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] Creating event network-vif-plugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:18:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-cf34be51-3c15-4db1-a18d-5d83890be117 req-051b9789-756e-4c9a-b077-96a6c9c78c4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031108 Apr 11 17:18:31 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 254/756] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:18:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "name": "network-vif-plugged", "status": "completed", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:37 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:37 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] Creating event network-vif-plugged:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:18:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-d1275e56-d0f9-4c08-8edd-301f34cea842 req-cb480058-860d-47c2-9646-5988b02429d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047011 Apr 11 17:18:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 252/757] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:18:39 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:39 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:39 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "name": "network-vif-plugged", "status": "completed", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:39 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:39 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] Creating event network-vif-plugged:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:18:39 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-057b3bcf-bca9-4849-837f-4b208f9f90be req-dabb7b82-053a-467d-8342-e134bebc50fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041159 Apr 11 17:18:39 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 252/758] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:18:54 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:54 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:54 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-042930c3-fb7a-4754-b1be-532ba1ef27ea tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:18:54 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-042930c3-fb7a-4754-b1be-532ba1ef27ea tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-042930c3-fb7a-4754-b1be-532ba1ef27ea tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-042930c3-fb7a-4754-b1be-532ba1ef27ea tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-042930c3-fb7a-4754-b1be-532ba1ef27ea tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-042930c3-fb7a-4754-b1be-532ba1ef27ea tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-042930c3-fb7a-4754-b1be-532ba1ef27ea tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:54 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-042930c3-fb7a-4754-b1be-532ba1ef27ea tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:55 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-042930c3-fb7a-4754-b1be-532ba1ef27ea tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-042930c3-fb7a-4754-b1be-532ba1ef27ea tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d" status: 200 len: 1549 microversion: 2.1 time: 0.177042 Apr 11 17:18:55 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 255/759] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:18:54 2023] GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:18:55 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:55 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:18:55 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:55 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:18:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-2a26ad4e-2937-48ea-b078-628a71faf2dc tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d" status: 204 len: 0 microversion: 2.1 time: 0.147533 Apr 11 17:18:55 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 253/760] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:18:55 2023] DELETE /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:18:55 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:18:55 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e03e8aa6-7976-4cd5-995c-fddb4db0fa9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:18:55 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e03e8aa6-7976-4cd5-995c-fddb4db0fa9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:18:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e03e8aa6-7976-4cd5-995c-fddb4db0fa9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e03e8aa6-7976-4cd5-995c-fddb4db0fa9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e03e8aa6-7976-4cd5-995c-fddb4db0fa9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e03e8aa6-7976-4cd5-995c-fddb4db0fa9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e03e8aa6-7976-4cd5-995c-fddb4db0fa9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e03e8aa6-7976-4cd5-995c-fddb4db0fa9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:55 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-e03e8aa6-7976-4cd5-995c-fddb4db0fa9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:18:55 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e03e8aa6-7976-4cd5-995c-fddb4db0fa9b tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d" status: 200 len: 1555 microversion: 2.1 time: 0.242853 Apr 11 17:18:55 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 253/761] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:18:55 2023] GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d => generated 1555 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 17:18:55 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b8cd04-945b-4926-b7fb-b6c65ed0164d", "name": "network-vif-unplugged", "status": "completed", "tag": "ace52784-2fcb-440a-8ff5-4fa05c330f9b"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] Creating event network-vif-unplugged:ace52784-2fcb-440a-8ff5-4fa05c330f9b for instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d on user Apr 11 17:18:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-15abca9e-d1e2-4dcc-acbd-c98a1ce4af0f req-bede383d-4e8f-46bd-974d-6e4dc3a5ad53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079658 Apr 11 17:18:55 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 256/762] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:18:57 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-fd44f886-4e72-472d-9482-bb08fae6aa5c req-2067cda7-bfb1-43c0-878d-12d68aa708e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b8cd04-945b-4926-b7fb-b6c65ed0164d", "name": "network-vif-deleted", "tag": "ace52784-2fcb-440a-8ff5-4fa05c330f9b"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fd44f886-4e72-472d-9482-bb08fae6aa5c req-2067cda7-bfb1-43c0-878d-12d68aa708e0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fd44f886-4e72-472d-9482-bb08fae6aa5c req-2067cda7-bfb1-43c0-878d-12d68aa708e0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fd44f886-4e72-472d-9482-bb08fae6aa5c req-2067cda7-bfb1-43c0-878d-12d68aa708e0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-fd44f886-4e72-472d-9482-bb08fae6aa5c req-2067cda7-bfb1-43c0-878d-12d68aa708e0 service nova] Creating event network-vif-deleted:ace52784-2fcb-440a-8ff5-4fa05c330f9b for instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d on user Apr 11 17:18:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-fd44f886-4e72-472d-9482-bb08fae6aa5c req-2067cda7-bfb1-43c0-878d-12d68aa708e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042646 Apr 11 17:18:57 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 254/763] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:18:57 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b8cd04-945b-4926-b7fb-b6c65ed0164d", "name": "network-vif-plugged", "status": "completed", "tag": "ace52784-2fcb-440a-8ff5-4fa05c330f9b"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:18:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:18:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:18:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:18:57 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] Creating event network-vif-plugged:ace52784-2fcb-440a-8ff5-4fa05c330f9b for instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d on user Apr 11 17:18:57 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-8785c124-dc8e-42a6-8506-c634d6646bba req-fdf823d0-fe3b-4e11-88f5-4e94c3d4d958 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027975 Apr 11 17:18:57 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 254/764] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:18:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:01 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] HTTP exception thrown: Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc could not be found. Apr 11 17:19:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Request method failure captured: Apr 11 17:19:01 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc HTTP/1.1 Apr 11 17:19:01 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:19:01 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:19:01 user devstack@n-api.service[61424]: Connection: close Apr 11 17:19:01 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:19:01 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:19:01 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:19:01 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:19:01 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZLG_8768-mQu9yCs4bl3OD1M7pFG45ape6z4ER5iPMh2_4MVeL8_JC_PQr_wQldSevDB4n3fAHGtPfGRkhDLtbmOK0lOZKqOM-mism8v_CCvVElUL8QJRBymW1T6rq6VlnL9Bw8r7y3LHYzyoUDFyNZbhaisWcl1Vc1hXgwyF33jcU Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Project-Id: 16e55c9209ac4b11b5af5ec1ad14d8b5 Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}] Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Tenant-Id: 16e55c9209ac4b11b5af5ec1ad14d8b5 Apr 11 17:19:01 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:19:01 user devstack@n-api.service[61424]: X-User: tempest-ServerRescueNegativeTestJSON-1553918933-project-member Apr 11 17:19:01 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:19:01 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:19:01 user devstack@n-api.service[61424]: X-User-Id: 3666d19053684843b400aab6ebf29cce Apr 11 17:19:01 user devstack@n-api.service[61424]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1553918933-project-member Apr 11 17:19:01 user devstack@n-api.service[61424]: method: > Apr 11 17:19:01 user devstack@n-api.service[61424]: exception: Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc could not be found. Apr 11 17:19:01 user devstack@n-api.service[61424]: action_args: {'id': '9e213b9c-23c4-4fe4-bd2f-2443ee3628bc'} Apr 11 17:19:01 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc could not be found. Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc could not be found. Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc could not be found. Apr 11 17:19:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:19:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Returning 404 to user: Instance 9e213b9c-23c4-4fe4-bd2f-2443ee3628bc could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:19:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f479fb2b-ed44-42f6-a6e2-616b10bbe516 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc" status: 404 len: 111 microversion: 2.1 time: 0.030496 Apr 11 17:19:01 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 257/765] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:01 2023] GET /compute/v2.1/servers/9e213b9c-23c4-4fe4-bd2f-2443ee3628bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:19:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a63ef6f3-8cfd-4626-bbcd-4a774e50c577 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '.version_select at 0x7f5bdd6f5fc0>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-a63ef6f3-8cfd-4626-bbcd-4a774e50c577 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-896312461" status: 202 len: 0 microversion: 2.1 time: 0.025119 Apr 11 17:19:01 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 255/766] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 17:19:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-896312461 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:19:04 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:04 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:04 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:19:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-4123418f-2c8d-46c6-81a7-2dfc7f21ac02 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd" status: 204 len: 0 microversion: 2.1 time: 0.345601 Apr 11 17:19:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 255/767] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:19:04 2023] DELETE /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:19:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-7f440cc9-64ab-405a-be6d-58611f44c592 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:04 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-7f440cc9-64ab-405a-be6d-58611f44c592 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f440cc9-64ab-405a-be6d-58611f44c592 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f440cc9-64ab-405a-be6d-58611f44c592 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f440cc9-64ab-405a-be6d-58611f44c592 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f440cc9-64ab-405a-be6d-58611f44c592 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f440cc9-64ab-405a-be6d-58611f44c592 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7f440cc9-64ab-405a-be6d-58611f44c592 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:04 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-7f440cc9-64ab-405a-be6d-58611f44c592 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-7f440cc9-64ab-405a-be6d-58611f44c592 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd" status: 200 len: 1497 microversion: 2.1 time: 0.208347 Apr 11 17:19:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 258/768] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:04 2023] GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd => generated 1497 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:19:05 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e3bca8-f38a-45d1-98c2-06391f9f31fd", "name": "network-vif-unplugged", "status": "completed", "tag": "153bd902-5486-49d7-8f56-9ac648664124"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] Creating event network-vif-unplugged:153bd902-5486-49d7-8f56-9ac648664124 for instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd on user Apr 11 17:19:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-99782f94-762b-41eb-90d9-d68d16d2ca0b req-d95deb4e-126f-4b76-b3b3-7e1bb3540142 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032817 Apr 11 17:19:05 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 256/769] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:06 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-41879be7-a07d-4c37-9258-6b88d0436426 req-9b42a29b-d27b-440a-a9aa-deb8b678bc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e3bca8-f38a-45d1-98c2-06391f9f31fd", "name": "network-vif-deleted", "tag": "153bd902-5486-49d7-8f56-9ac648664124"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:06 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-41879be7-a07d-4c37-9258-6b88d0436426 req-9b42a29b-d27b-440a-a9aa-deb8b678bc6b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:06 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-41879be7-a07d-4c37-9258-6b88d0436426 req-9b42a29b-d27b-440a-a9aa-deb8b678bc6b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:06 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-41879be7-a07d-4c37-9258-6b88d0436426 req-9b42a29b-d27b-440a-a9aa-deb8b678bc6b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:06 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-41879be7-a07d-4c37-9258-6b88d0436426 req-9b42a29b-d27b-440a-a9aa-deb8b678bc6b service nova] Creating event network-vif-deleted:153bd902-5486-49d7-8f56-9ac648664124 for instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd on user Apr 11 17:19:06 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-41879be7-a07d-4c37-9258-6b88d0436426 req-9b42a29b-d27b-440a-a9aa-deb8b678bc6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028752 Apr 11 17:19:06 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 256/770] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:07 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58e3bca8-f38a-45d1-98c2-06391f9f31fd", "name": "network-vif-plugged", "status": "completed", "tag": "153bd902-5486-49d7-8f56-9ac648664124"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] Creating event network-vif-plugged:153bd902-5486-49d7-8f56-9ac648664124 for instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd on user Apr 11 17:19:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-579e529c-5d8a-4d69-b30a-e50995e7ca3a req-11d2883c-8f3c-4545-8b4f-b8caa6ef232f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030157 Apr 11 17:19:07 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 259/771] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-032374fe-8102-4399-b82b-99923d9a5c8d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:07 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-032374fe-8102-4399-b82b-99923d9a5c8d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-032374fe-8102-4399-b82b-99923d9a5c8d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-032374fe-8102-4399-b82b-99923d9a5c8d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-032374fe-8102-4399-b82b-99923d9a5c8d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-032374fe-8102-4399-b82b-99923d9a5c8d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-032374fe-8102-4399-b82b-99923d9a5c8d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-032374fe-8102-4399-b82b-99923d9a5c8d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-032374fe-8102-4399-b82b-99923d9a5c8d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.096117 Apr 11 17:19:07 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 257/772] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:19:07 2023] GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/os-interface => generated 282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:08 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5569d684-f720-4ca3-9d15-3ed808a81a65 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:08 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-5569d684-f720-4ca3-9d15-3ed808a81a65 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5569d684-f720-4ca3-9d15-3ed808a81a65 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5569d684-f720-4ca3-9d15-3ed808a81a65 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5569d684-f720-4ca3-9d15-3ed808a81a65 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5569d684-f720-4ca3-9d15-3ed808a81a65 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5569d684-f720-4ca3-9d15-3ed808a81a65 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5569d684-f720-4ca3-9d15-3ed808a81a65 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:08 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-5569d684-f720-4ca3-9d15-3ed808a81a65 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/ips" status: 200 len: 108 microversion: 2.1 time: 0.035403 Apr 11 17:19:08 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 257/773] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 17:19:08 2023] GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/ips => generated 108 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:09 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5f9fe94-98f0-4094-8003-53c06cbfd5cb", "tag": "4ec17eb0-1b20-4679-9900-3fa2850b50b8"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:09 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] Creating event network-changed:4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb on user Apr 11 17:19:09 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-1483c537-db86-4c85-ba00-6d295e0abbf8 req-769ec50b-a64a-4443-bb0c-352426c8f3d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029510 Apr 11 17:19:09 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 260/774] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b9154d8-9977-4c02-89a1-26975750e0a5"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:09 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b189a960-d426-4ab1-8387-9398e0e5880c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279690 Apr 11 17:19:09 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 258/775] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:19:09 2023] POST /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:12 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:12 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:12 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:12 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:12 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:12 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ecaf9118-7b20-447f-b424-e086046c0c7f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2" status: 200 len: 1784 microversion: 2.20 time: 0.155798 Apr 11 17:19:12 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 258/776] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:19:12 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 => generated 1784 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:19:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:16 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9034e1f1-6e5c-41e5-9b7f-33b7d4e4dc11 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd836b00>, body: {"keypair": {"name": "tempest-keypair-1047793130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCuqLGitNmsyVl6DZ1ST80abe9aOW0E48/T6TICTipu2zcFtu5oS+mkIEMmnW66SQRO+/LAO1Q8Zo0FD1QUJVbuMdMPql+IgEKelMKNrv1CNM86lLuJwhRYOR7Ri5AxeA=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:16 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:16 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-9034e1f1-6e5c-41e5-9b7f-33b7d4e4dc11 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for project 23c663a759724bbda32f189ceedf6675. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:19:16 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:16 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-9034e1f1-6e5c-41e5-9b7f-33b7d4e4dc11 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for user ff27d08254f74491aba3386c9b901300 and project 23c663a759724bbda32f189ceedf6675. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:19:16 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-0cd32c70-205c-4c2e-8cf6-123ace8515d5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" status: 200 len: 1770 microversion: 2.87 time: 0.166209 Apr 11 17:19:16 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 261/777] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:19:16 2023] GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => generated 1770 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:19:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9034e1f1-6e5c-41e5-9b7f-33b7d4e4dc11 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059319 Apr 11 17:19:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 259/778] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:19:16 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-859055886", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2"}], "security_groups": [{"name": "tempest-securitygroup--1177271398"}], "key_name": "tempest-keypair-1047793130", "user_data": "}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] validate_networks() for [('f6d30218-0af4-4ce4-bb7e-990a43a37ec2', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for project 23c663a759724bbda32f189ceedf6675. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for user ff27d08254f74491aba3386c9b901300 and project 23c663a759724bbda32f189ceedf6675. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:19:18 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:19:18 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-b53e2c18-1daf-484b-8889-3a41949223ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.622479 Apr 11 17:19:18 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 259/779] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:19:18 2023] POST /compute/v2.1/servers => generated 400 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:19:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-03d9f2da-de46-4517-922a-71a9b3b197e8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:18 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-03d9f2da-de46-4517-922a-71a9b3b197e8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:18 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-03d9f2da-de46-4517-922a-71a9b3b197e8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-03d9f2da-de46-4517-922a-71a9b3b197e8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" status: 200 len: 1235 microversion: 2.1 time: 0.063776 Apr 11 17:19:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 262/780] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:18 2023] GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc => generated 1235 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:19:22 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:22 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc", "tag": "714e84f4-64ee-4448-9681-881a322ec1a8"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] Creating event network-changed:714e84f4-64ee-4448-9681-881a322ec1a8 for instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc on user Apr 11 17:19:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-1abf6086-ebdc-4844-b808-27ea3c8b29cb req-a71f1183-788b-4b21-b346-b0cb3fb2df9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060155 Apr 11 17:19:22 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 260/781] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:22 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-88d9a5c3-4d5d-4b42-8fbb-07d8559cda17 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:22 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-88d9a5c3-4d5d-4b42-8fbb-07d8559cda17 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88d9a5c3-4d5d-4b42-8fbb-07d8559cda17 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88d9a5c3-4d5d-4b42-8fbb-07d8559cda17 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88d9a5c3-4d5d-4b42-8fbb-07d8559cda17 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88d9a5c3-4d5d-4b42-8fbb-07d8559cda17 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88d9a5c3-4d5d-4b42-8fbb-07d8559cda17 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-88d9a5c3-4d5d-4b42-8fbb-07d8559cda17 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:22 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-88d9a5c3-4d5d-4b42-8fbb-07d8559cda17 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.193113 Apr 11 17:19:22 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 260/782] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:19:22 2023] GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1/os-interface => generated 283 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:24 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a306a5-f981-495f-9f3a-8fd5011b4ce1", "tag": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:24 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] Creating event network-changed:2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 on user Apr 11 17:19:24 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-150755ad-9bd2-49d3-a6ca-fed323d5c47a req-ec53352d-23cf-47f2-a109-769022bf7d0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047404 Apr 11 17:19:24 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 263/783] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-95786467", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "a3d41d47-6b37-4493-ac8f-572031c1a620"}], "security_groups": [{"name": "tempest-securitygroup--2090478013"}], "key_name": "tempest-keypair-1019962913", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "2bead45a-38fa-42b7-bd54-8c1f88c67e01", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] validate_networks() for [('a3d41d47-6b37-4493-ac8f-572031c1a620', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for project db242f5f39d94966948e8b487cd52d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for user 8f4ba7d7f3f74b5c800be2408c1035e2 and project db242f5f39d94966948e8b487cd52d0c. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:19:25 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2bead45a-38fa-42b7-bd54-8c1f88c67e01',volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:19:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-0187c588-6d60-433e-ab43-d7e40ad5109e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.726550 Apr 11 17:19:26 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 261/784] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:19:25 2023] POST /compute/v2.1/servers => generated 404 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:19:26 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-48b08be3-b4d3-4333-b4ee-172a92af5e23 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:26 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-48b08be3-b4d3-4333-b4ee-172a92af5e23 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:26 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:26 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-48b08be3-b4d3-4333-b4ee-172a92af5e23 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:26 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-48b08be3-b4d3-4333-b4ee-172a92af5e23 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 200 len: 1074 microversion: 2.1 time: 0.067980 Apr 11 17:19:26 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 261/785] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:26 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 1074 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:19:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc", "name": "network-vif-plugged", "status": "completed", "tag": "714e84f4-64ee-4448-9681-881a322ec1a8"}, {"server_uuid": "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc", "name": "network-vif-plugged", "status": "completed", "tag": "714e84f4-64ee-4448-9681-881a322ec1a8"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:26 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=23 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:26 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=29 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Creating event network-vif-plugged:714e84f4-64ee-4448-9681-881a322ec1a8 for instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc on user Apr 11 17:19:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] Creating event network-vif-plugged:714e84f4-64ee-4448-9681-881a322ec1a8 for instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc on user Apr 11 17:19:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-086eec77-1905-4a5a-ad2c-6319f44d1fd1 req-d2b40c4a-2b83-4725-927f-796081326ce9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032442 Apr 11 17:19:26 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 264/786] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:26 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ea453041-c9ca-4d1a-bd54-c8308433d074 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:26 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ea453041-c9ca-4d1a-bd54-c8308433d074 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ea453041-c9ca-4d1a-bd54-c8308433d074 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ea453041-c9ca-4d1a-bd54-c8308433d074 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ea453041-c9ca-4d1a-bd54-c8308433d074 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ea453041-c9ca-4d1a-bd54-c8308433d074 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ea453041-c9ca-4d1a-bd54-c8308433d074 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ea453041-c9ca-4d1a-bd54-c8308433d074 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:27 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ea453041-c9ca-4d1a-bd54-c8308433d074 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:27 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ea453041-c9ca-4d1a-bd54-c8308433d074 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6" status: 200 len: 1536 microversion: 2.1 time: 0.149779 Apr 11 17:19:27 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 262/787] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:26 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 => generated 1536 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:19:27 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b5355e7a-3954-4f22-a6a3-646487dcc60d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:27 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-b5355e7a-3954-4f22-a6a3-646487dcc60d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:27 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-b5355e7a-3954-4f22-a6a3-646487dcc60d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Searching by: {'deleted': False, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91'} {{(pid=61423) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 17:19:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b5355e7a-3954-4f22-a6a3-646487dcc60d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b5355e7a-3954-4f22-a6a3-646487dcc60d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b5355e7a-3954-4f22-a6a3-646487dcc60d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b5355e7a-3954-4f22-a6a3-646487dcc60d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b5355e7a-3954-4f22-a6a3-646487dcc60d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b5355e7a-3954-4f22-a6a3-646487dcc60d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:27 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:27 user devstack@n-api.service[61423]: DEBUG nova.compute.multi_cell_list [None req-b5355e7a-3954-4f22-a6a3-646487dcc60d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61423) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 17:19:27 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-b5355e7a-3954-4f22-a6a3-646487dcc60d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.157237 Apr 11 17:19:27 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 262/788] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 17:19:27 2023] GET /compute/v2.1/servers => generated 340 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:27 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-5900a5c5-4969-40d8-8320-db97af54a011 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:27 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-5900a5c5-4969-40d8-8320-db97af54a011 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5900a5c5-4969-40d8-8320-db97af54a011 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5900a5c5-4969-40d8-8320-db97af54a011 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5900a5c5-4969-40d8-8320-db97af54a011 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5900a5c5-4969-40d8-8320-db97af54a011 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5900a5c5-4969-40d8-8320-db97af54a011 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5900a5c5-4969-40d8-8320-db97af54a011 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:27 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-5900a5c5-4969-40d8-8320-db97af54a011 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-5900a5c5-4969-40d8-8320-db97af54a011 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6" status: 200 len: 1536 microversion: 2.1 time: 0.227451 Apr 11 17:19:27 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 265/789] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:27 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 => generated 1536 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 17:19:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40270cb6-8b7f-4658-8ea8-17a800d63f2d", "tag": "09360ccd-e24b-449a-9e15-b86a5a12b501"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] Creating event network-changed:09360ccd-e24b-449a-9e15-b86a5a12b501 for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d on user Apr 11 17:19:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-368a958b-be93-4c1f-a5d4-6893a7930658 req-be44f68f-8070-49a9-8f4e-30883dbaa7b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052677 Apr 11 17:19:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 263/790] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:29 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d97aa7e6-492f-4a89-9305-d2c10afa79a6"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:29 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:29 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-be69d8ca-58c0-499a-b451-29ea85a7fe38 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630253 Apr 11 17:19:29 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 263/791] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:19:29 2023] POST /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/os-volume_attachments => generated 194 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:35 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40270cb6-8b7f-4658-8ea8-17a800d63f2d", "name": "network-vif-plugged", "status": "completed", "tag": "09360ccd-e24b-449a-9e15-b86a5a12b501"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:35 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] Creating event network-vif-plugged:09360ccd-e24b-449a-9e15-b86a5a12b501 for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d on user Apr 11 17:19:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-99314c82-a889-44bd-b1a2-ad99cf40d6f2 req-cee02a8f-e63f-4568-b918-6df3829593ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040703 Apr 11 17:19:35 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 266/792] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:37 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:37 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=10 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40270cb6-8b7f-4658-8ea8-17a800d63f2d", "name": "network-vif-plugged", "status": "completed", "tag": "09360ccd-e24b-449a-9e15-b86a5a12b501"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] Creating event network-vif-plugged:09360ccd-e24b-449a-9e15-b86a5a12b501 for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d on user Apr 11 17:19:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-395481ee-ee25-4599-b022-040a554fcfb9 req-4d50d533-d602-4ac8-99b6-52fd55f1f1b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 Apr 11 17:19:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 264/793] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ac41d844-b95a-4dec-a136-cdc3fb6942a8 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:37 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ac41d844-b95a-4dec-a136-cdc3fb6942a8 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:37 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:37 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac41d844-b95a-4dec-a136-cdc3fb6942a8 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac41d844-b95a-4dec-a136-cdc3fb6942a8 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac41d844-b95a-4dec-a136-cdc3fb6942a8 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac41d844-b95a-4dec-a136-cdc3fb6942a8 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac41d844-b95a-4dec-a136-cdc3fb6942a8 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ac41d844-b95a-4dec-a136-cdc3fb6942a8 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:37 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ac41d844-b95a-4dec-a136-cdc3fb6942a8 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ac41d844-b95a-4dec-a136-cdc3fb6942a8 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6" status: 200 len: 1582 microversion: 2.1 time: 0.170151 Apr 11 17:19:37 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 264/794] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:37 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 => generated 1582 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:19:39 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] Creating event network-changed:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:19:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-959c2f16-12e5-4787-b227-35f6a77a10e8 req-542b6c8c-e519-4ff8-8a81-d988bc913159 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036926 Apr 11 17:19:39 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 267/795] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-78cc8200-90a7-4332-be17-e5be3dd500b3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-236225711"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:40 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-78cc8200-90a7-4332-be17-e5be3dd500b3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-78cc8200-90a7-4332-be17-e5be3dd500b3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-78cc8200-90a7-4332-be17-e5be3dd500b3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-78cc8200-90a7-4332-be17-e5be3dd500b3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-78cc8200-90a7-4332-be17-e5be3dd500b3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-78cc8200-90a7-4332-be17-e5be3dd500b3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-78cc8200-90a7-4332-be17-e5be3dd500b3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:41 user devstack@n-api.service[61422]: INFO nova.network.security_group_api [None req-78cc8200-90a7-4332-be17-e5be3dd500b3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Adding security group 1f3acf80-5fb5-460e-a8a0-9cf47f0ee4cc to port ef4e04c8-3073-425e-a10b-ca224239fd2f Apr 11 17:19:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-78cc8200-90a7-4332-be17-e5be3dd500b3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/action" status: 202 len: 0 microversion: 2.1 time: 0.622916 Apr 11 17:19:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 265/796] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:19:40 2023] POST /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:19:41 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-9d61a94a-8573-4629-b881-79de3a6b73e6 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:41 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-9d61a94a-8573-4629-b881-79de3a6b73e6 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:41 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9d61a94a-8573-4629-b881-79de3a6b73e6 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9d61a94a-8573-4629-b881-79de3a6b73e6 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9d61a94a-8573-4629-b881-79de3a6b73e6 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9d61a94a-8573-4629-b881-79de3a6b73e6 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9d61a94a-8573-4629-b881-79de3a6b73e6 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9d61a94a-8573-4629-b881-79de3a6b73e6 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:41 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] Creating event network-changed:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:19:41 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-687ff727-28ae-4089-97bf-8d6f4b9931c2 req-31c05045-dcee-4523-8cd0-941d3e32436d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034113 Apr 11 17:19:41 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 268/797] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:41 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-9d61a94a-8573-4629-b881-79de3a6b73e6 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-9d61a94a-8573-4629-b881-79de3a6b73e6 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6" status: 200 len: 1747 microversion: 2.1 time: 0.240594 Apr 11 17:19:41 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 265/798] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:41 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 => generated 1747 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:19:42 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:42 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:43 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-32eecf75-0861-48be-b20b-2741737c2e46 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/action" status: 202 len: 0 microversion: 2.1 time: 0.087945 Apr 11 17:19:43 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 266/799] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:19:42 2023] POST /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:19:43 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c66adfaf-8c25-4900-8155-53515e6118e1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:43 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c66adfaf-8c25-4900-8155-53515e6118e1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c66adfaf-8c25-4900-8155-53515e6118e1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c66adfaf-8c25-4900-8155-53515e6118e1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c66adfaf-8c25-4900-8155-53515e6118e1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c66adfaf-8c25-4900-8155-53515e6118e1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c66adfaf-8c25-4900-8155-53515e6118e1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:43 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c66adfaf-8c25-4900-8155-53515e6118e1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:43 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-c66adfaf-8c25-4900-8155-53515e6118e1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:43 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c66adfaf-8c25-4900-8155-53515e6118e1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6" status: 200 len: 1749 microversion: 2.1 time: 0.557886 Apr 11 17:19:43 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 269/800] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:43 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 => generated 1749 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:19:44 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "name": "network-vif-unplugged", "status": "completed", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:44 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] Creating event network-vif-unplugged:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:19:44 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-bfef3ffd-0ad8-4da5-b012-0883d3a6d863 req-ae420676-c321-4f0a-b796-5f63abd51fb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029000 Apr 11 17:19:44 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 266/801] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:45 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:45 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:45 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:19:45 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:19:45 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d HTTP/1.1 Apr 11 17:19:45 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:19:45 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:19:45 user devstack@n-api.service[61422]: Connection: close Apr 11 17:19:45 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:19:45 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:19:45 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:19:45 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:19:45 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:19:45 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:19:45 user devstack@n-api.service[61422]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:19:45 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:19:45 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:19:45 user devstack@n-api.service[61422]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:19:45 user devstack@n-api.service[61422]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:19:45 user devstack@n-api.service[61422]: method: > Apr 11 17:19:45 user devstack@n-api.service[61422]: exception: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:19:45 user devstack@n-api.service[61422]: action_args: {'id': 'd0b8cd04-945b-4926-b7fb-b6c65ed0164d'} Apr 11 17:19:45 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:19:45 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:19:45 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:19:45 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8cf8104f-d751-436d-8192-0aa2688e43f4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d" status: 404 len: 111 microversion: 2.1 time: 0.030289 Apr 11 17:19:45 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 267/802] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:45 2023] GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:19:46 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "name": "network-vif-plugged", "status": "completed", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:46 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] Creating event network-vif-plugged:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:19:46 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-95247263-0cd3-458d-a107-260df46e7142 req-ec22605d-24cb-4acc-9597-7ffbe302b0c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032206 Apr 11 17:19:46 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 270/803] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:46 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:46 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:46 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:19:47 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-37905c87-5f44-4dff-834b-78d879ecae77 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7" status: 204 len: 0 microversion: 2.1 time: 0.111014 Apr 11 17:19:47 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 267/804] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:19:46 2023] DELETE /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:19:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-797e7d11-7e18-4a2a-b777-ccd58bc33ee6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:47 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-797e7d11-7e18-4a2a-b777-ccd58bc33ee6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-797e7d11-7e18-4a2a-b777-ccd58bc33ee6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-797e7d11-7e18-4a2a-b777-ccd58bc33ee6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-797e7d11-7e18-4a2a-b777-ccd58bc33ee6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-797e7d11-7e18-4a2a-b777-ccd58bc33ee6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-797e7d11-7e18-4a2a-b777-ccd58bc33ee6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-797e7d11-7e18-4a2a-b777-ccd58bc33ee6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:47 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-797e7d11-7e18-4a2a-b777-ccd58bc33ee6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-797e7d11-7e18-4a2a-b777-ccd58bc33ee6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7" status: 200 len: 1398 microversion: 2.1 time: 0.207394 Apr 11 17:19:47 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 268/805] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:47 2023] GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7 => generated 1398 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:19:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df974dc8-deda-4bdb-bb9d-1471bee040a7", "name": "network-vif-unplugged", "status": "completed", "tag": "11a50593-74fe-4bfd-adc1-15e1537afc66"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:47 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] Creating event network-vif-unplugged:11a50593-74fe-4bfd-adc1-15e1537afc66 for instance df974dc8-deda-4bdb-bb9d-1471bee040a7 on user Apr 11 17:19:47 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-280b0068-e17a-4748-af85-db8ff6d256c9 req-566838d8-f7ce-4032-a868-e5e2ea67710b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074702 Apr 11 17:19:47 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 271/806] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:49 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "name": "network-vif-plugged", "status": "completed", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:49 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] Creating event network-vif-plugged:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:19:49 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-55270a8c-bf10-4016-876a-8f23c28bfaaa req-c1a1c6d3-c08d-4f85-9f1c-0589c79a454a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048266 Apr 11 17:19:49 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 268/807] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:49 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-7ca7cd3d-a657-436b-a3db-c13e5a475758 req-adf1c0a5-c1ca-438a-be33-0066aa37555e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df974dc8-deda-4bdb-bb9d-1471bee040a7", "name": "network-vif-deleted", "tag": "11a50593-74fe-4bfd-adc1-15e1537afc66"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7ca7cd3d-a657-436b-a3db-c13e5a475758 req-adf1c0a5-c1ca-438a-be33-0066aa37555e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7ca7cd3d-a657-436b-a3db-c13e5a475758 req-adf1c0a5-c1ca-438a-be33-0066aa37555e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7ca7cd3d-a657-436b-a3db-c13e5a475758 req-adf1c0a5-c1ca-438a-be33-0066aa37555e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:49 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-7ca7cd3d-a657-436b-a3db-c13e5a475758 req-adf1c0a5-c1ca-438a-be33-0066aa37555e service nova] Creating event network-vif-deleted:11a50593-74fe-4bfd-adc1-15e1537afc66 for instance df974dc8-deda-4bdb-bb9d-1471bee040a7 on user Apr 11 17:19:49 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-7ca7cd3d-a657-436b-a3db-c13e5a475758 req-adf1c0a5-c1ca-438a-be33-0066aa37555e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040418 Apr 11 17:19:49 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 269/808] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:49 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df974dc8-deda-4bdb-bb9d-1471bee040a7", "name": "network-vif-plugged", "status": "completed", "tag": "11a50593-74fe-4bfd-adc1-15e1537afc66"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:49 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:49 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] Creating event network-vif-plugged:11a50593-74fe-4bfd-adc1-15e1537afc66 for instance df974dc8-deda-4bdb-bb9d-1471bee040a7 on user Apr 11 17:19:49 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-6a65fdd0-b649-4648-8bd1-14c9c2e69f0c req-24c84e76-bae6-4d5c-8f20-3ff498babfe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035675 Apr 11 17:19:49 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 272/809] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:51 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "name": "network-vif-plugged", "status": "completed", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:51 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] Creating event network-vif-plugged:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:19:51 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-1e6cae12-4128-48c1-b4e3-ae307b8d0242 req-e8fb26df-3647-48aa-bef2-f5eb4ed4ccb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030128 Apr 11 17:19:51 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 269/810] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 58e3bca8-f38a-45d1-98c2-06391f9f31fd] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] HTTP exception thrown: Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd could not be found. Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Request method failure captured: Apr 11 17:19:55 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd HTTP/1.1 Apr 11 17:19:55 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:19:55 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:19:55 user devstack@n-api.service[61422]: Connection: close Apr 11 17:19:55 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:19:55 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:19:55 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:19:55 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:19:55 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLG_8768-mQu9yCs4bl3OD1M7pFG45ape6z4ER5iPMh2_4MVeL8_JC_PQr_wQldSevDB4n3fAHGtPfGRkhDLtbmOK0lOZKqOM-mism8v_CCvVElUL8QJRBymW1T6rq6VlnL9Bw8r7y3LHYzyoUDFyNZbhaisWcl1Vc1hXgwyF33jcU Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Project-Id: 16e55c9209ac4b11b5af5ec1ad14d8b5 Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}] Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Tenant-Id: 16e55c9209ac4b11b5af5ec1ad14d8b5 Apr 11 17:19:55 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:19:55 user devstack@n-api.service[61422]: X-User: tempest-ServerRescueNegativeTestJSON-1553918933-project-member Apr 11 17:19:55 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:19:55 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:19:55 user devstack@n-api.service[61422]: X-User-Id: 3666d19053684843b400aab6ebf29cce Apr 11 17:19:55 user devstack@n-api.service[61422]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1553918933-project-member Apr 11 17:19:55 user devstack@n-api.service[61422]: method: > Apr 11 17:19:55 user devstack@n-api.service[61422]: exception: Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd could not be found. Apr 11 17:19:55 user devstack@n-api.service[61422]: action_args: {'id': '58e3bca8-f38a-45d1-98c2-06391f9f31fd'} Apr 11 17:19:55 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd could not be found. Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd could not be found. Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd could not be found. Apr 11 17:19:55 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Returning 404 to user: Instance 58e3bca8-f38a-45d1-98c2-06391f9f31fd could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:19:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ddcfc6c4-d54c-4d99-8820-c9d568da4251 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd" status: 404 len: 111 microversion: 2.1 time: 0.187150 Apr 11 17:19:55 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 270/811] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:55 2023] GET /compute/v2.1/servers/58e3bca8-f38a-45d1-98c2-06391f9f31fd => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 17:19:55 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:55 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:55 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:19:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ee24af4b-a83f-49de-b223-731c2e2e0860 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c" status: 204 len: 0 microversion: 2.1 time: 0.122502 Apr 11 17:19:55 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 273/812] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:19:55 2023] DELETE /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:19:55 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e4fea9a5-3930-47ca-a836-b7460924c62a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:19:55 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e4fea9a5-3930-47ca-a836-b7460924c62a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:19:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e4fea9a5-3930-47ca-a836-b7460924c62a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e4fea9a5-3930-47ca-a836-b7460924c62a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e4fea9a5-3930-47ca-a836-b7460924c62a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e4fea9a5-3930-47ca-a836-b7460924c62a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e4fea9a5-3930-47ca-a836-b7460924c62a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:55 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e4fea9a5-3930-47ca-a836-b7460924c62a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:55 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-e4fea9a5-3930-47ca-a836-b7460924c62a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3666d19053684843b400aab6ebf29cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16e55c9209ac4b11b5af5ec1ad14d8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:19:55 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e4fea9a5-3930-47ca-a836-b7460924c62a tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c" status: 200 len: 1510 microversion: 2.1 time: 0.221631 Apr 11 17:19:55 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 270/813] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:19:55 2023] GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-unplugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:55 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] Creating event network-vif-unplugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:19:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-8ce7ecea-bd43-4f45-b128-8faa265994d1 req-b610b5f6-ccdc-47db-8878-0fe6dda742b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033401 Apr 11 17:19:55 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 271/814] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:19:57 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-plugged", "status": "completed", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}, {"server_uuid": "25935a69-292b-4d55-932c-f4893838998c", "name": "network-vif-deleted", "tag": "b26876bb-0ee7-42f8-a592-b9078cd9701a"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:19:57 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:19:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:19:57 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:19:57 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:19:57 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] Creating event network-vif-plugged:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:19:57 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] Creating event network-vif-deleted:b26876bb-0ee7-42f8-a592-b9078cd9701a for instance 25935a69-292b-4d55-932c-f4893838998c on user Apr 11 17:19:57 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-4d2d8692-0660-41cb-902f-86521c30697a req-5e60466d-9269-4ec7-8532-71a9fdc82405 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034685 Apr 11 17:19:57 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 274/815] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:19:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:20:09 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:09 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:09 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5595c603-d61d-4b40-8f5b-434690de780c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:09 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-5595c603-d61d-4b40-8f5b-434690de780c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5595c603-d61d-4b40-8f5b-434690de780c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5595c603-d61d-4b40-8f5b-434690de780c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5595c603-d61d-4b40-8f5b-434690de780c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5595c603-d61d-4b40-8f5b-434690de780c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5595c603-d61d-4b40-8f5b-434690de780c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5595c603-d61d-4b40-8f5b-434690de780c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:09 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-5595c603-d61d-4b40-8f5b-434690de780c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:20:09 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-5595c603-d61d-4b40-8f5b-434690de780c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" status: 200 len: 1545 microversion: 2.1 time: 0.189600 Apr 11 17:20:09 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 271/816] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:20:09 2023] GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc => generated 1545 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:20:12 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:12 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e58b24b3-ffd2-4b09-b68d-8e7def46640f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:13 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e58b24b3-ffd2-4b09-b68d-8e7def46640f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e58b24b3-ffd2-4b09-b68d-8e7def46640f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e58b24b3-ffd2-4b09-b68d-8e7def46640f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e58b24b3-ffd2-4b09-b68d-8e7def46640f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e58b24b3-ffd2-4b09-b68d-8e7def46640f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e58b24b3-ffd2-4b09-b68d-8e7def46640f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e58b24b3-ffd2-4b09-b68d-8e7def46640f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e58b24b3-ffd2-4b09-b68d-8e7def46640f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-volume_attachments/5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b" status: 200 len: 194 microversion: 2.20 time: 0.171080 Apr 11 17:20:13 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 272/817] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Apr 11 17:20:12 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-volume_attachments/5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b => generated 194 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:20:13 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:13 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:13 user devstack@n-api.service[61424]: DEBUG nova.objects.instance [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'services' on Instance uuid 49e044ae-91af-4db8-b0fe-3679dd210ab2 {{(pid=61424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:20:13 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-49738f2f-78ce-49c1-9ea5-8aa04613bb34 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-volume_attachments/5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b" status: 202 len: 0 microversion: 2.20 time: 0.205693 Apr 11 17:20:13 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 275/818] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 17:20:13 2023] DELETE /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-volume_attachments/5ef974a2-b7d0-45ed-bfa9-6de4ed76cb6b => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:20:13 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-35b34d08-3a2d-45e6-aa59-d203872ca0b7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:13 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-35b34d08-3a2d-45e6-aa59-d203872ca0b7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b34d08-3a2d-45e6-aa59-d203872ca0b7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b34d08-3a2d-45e6-aa59-d203872ca0b7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b34d08-3a2d-45e6-aa59-d203872ca0b7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b34d08-3a2d-45e6-aa59-d203872ca0b7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b34d08-3a2d-45e6-aa59-d203872ca0b7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b34d08-3a2d-45e6-aa59-d203872ca0b7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:13 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-35b34d08-3a2d-45e6-aa59-d203872ca0b7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045291 Apr 11 17:20:13 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 272/819] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 17:20:13 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:20:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-20d79bbc-9ddf-4ea4-b9fe-3b040d0d657f tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:16 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-20d79bbc-9ddf-4ea4-b9fe-3b040d0d657f tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-20d79bbc-9ddf-4ea4-b9fe-3b040d0d657f tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-20d79bbc-9ddf-4ea4-b9fe-3b040d0d657f tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-20d79bbc-9ddf-4ea4-b9fe-3b040d0d657f tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-20d79bbc-9ddf-4ea4-b9fe-3b040d0d657f tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-20d79bbc-9ddf-4ea4-b9fe-3b040d0d657f tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-20d79bbc-9ddf-4ea4-b9fe-3b040d0d657f tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:16 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-20d79bbc-9ddf-4ea4-b9fe-3b040d0d657f tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:20:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-20d79bbc-9ddf-4ea4-b9fe-3b040d0d657f tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 200 len: 1428 microversion: 2.1 time: 0.147819 Apr 11 17:20:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 273/820] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:20:16 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 1428 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:20:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:16 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:16 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:20:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-8d003711-ad88-4044-97ce-0a1640721ffc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" status: 204 len: 0 microversion: 2.87 time: 0.210262 Apr 11 17:20:16 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 276/821] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:20:16 2023] DELETE /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:20:16 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:16 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:16 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:20:16 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:20:16 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:20:16 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2052d107-c377-4bc8-9ef2-0af3f76a48c3 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" status: 200 len: 1776 microversion: 2.87 time: 0.175149 Apr 11 17:20:16 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 273/822] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:20:16 2023] GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => generated 1776 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:20:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-unplugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:20:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] Creating event network-vif-unplugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:20:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-93c030ec-99c1-4f37-a9a4-bdb536bcbf1f req-ae95b43d-3015-4605-8c34-b011204f55ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094537 Apr 11 17:20:17 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 274/823] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:20:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:20:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-b50b5a4c-e1b0-43e5-91b1-f4917157c089 req-bdb42761-9011-4f41-9a51-d9c243a603c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-deleted", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:20:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b50b5a4c-e1b0-43e5-91b1-f4917157c089 req-bdb42761-9011-4f41-9a51-d9c243a603c9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b50b5a4c-e1b0-43e5-91b1-f4917157c089 req-bdb42761-9011-4f41-9a51-d9c243a603c9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b50b5a4c-e1b0-43e5-91b1-f4917157c089 req-bdb42761-9011-4f41-9a51-d9c243a603c9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-b50b5a4c-e1b0-43e5-91b1-f4917157c089 req-bdb42761-9011-4f41-9a51-d9c243a603c9 service nova] Creating event network-vif-deleted:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:20:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-b50b5a4c-e1b0-43e5-91b1-f4917157c089 req-bdb42761-9011-4f41-9a51-d9c243a603c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029486 Apr 11 17:20:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 277/824] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:20:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:20:19 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8", "name": "network-vif-plugged", "status": "completed", "tag": "7436f349-9b31-46f1-9866-ad1d71d06e06"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:20:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:19 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] Creating event network-vif-plugged:7436f349-9b31-46f1-9866-ad1d71d06e06 for instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 on user Apr 11 17:20:19 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-adfa0cae-b492-4a30-9a07-516724f32e2d req-08ef64af-9ba6-438f-b95a-ffefdd0d6ebe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030463 Apr 11 17:20:19 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 274/825] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:20:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:20:33 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:33 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=14 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a7a8ad6a-5ee4-48fa-8cf7-a4321b925303 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:33 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a7a8ad6a-5ee4-48fa-8cf7-a4321b925303 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a7a8ad6a-5ee4-48fa-8cf7-a4321b925303 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a7a8ad6a-5ee4-48fa-8cf7-a4321b925303 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a7a8ad6a-5ee4-48fa-8cf7-a4321b925303 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a7a8ad6a-5ee4-48fa-8cf7-a4321b925303 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a7a8ad6a-5ee4-48fa-8cf7-a4321b925303 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a7a8ad6a-5ee4-48fa-8cf7-a4321b925303 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:33 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-a7a8ad6a-5ee4-48fa-8cf7-a4321b925303 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:20:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-a7a8ad6a-5ee4-48fa-8cf7-a4321b925303 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6" status: 200 len: 1747 microversion: 2.1 time: 0.171469 Apr 11 17:20:33 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 275/826] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:20:33 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 => generated 1747 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:37 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:20:37 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7 HTTP/1.1 Apr 11 17:20:37 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:20:37 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:20:37 user devstack@n-api.service[61424]: Connection: close Apr 11 17:20:37 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:20:37 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:20:37 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:20:37 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:20:37 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:20:37 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:20:37 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:20:37 user devstack@n-api.service[61424]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:20:37 user devstack@n-api.service[61424]: method: > Apr 11 17:20:37 user devstack@n-api.service[61424]: exception: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61424]: action_args: {'id': 'df974dc8-deda-4bdb-bb9d-1471bee040a7'} Apr 11 17:20:37 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:20:37 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-145d9f65-48d0-406c-b57a-ab98672ee247 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7" status: 404 len: 111 microversion: 2.1 time: 0.037196 Apr 11 17:20:37 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 278/827] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:20:37 2023] GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=10 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=20 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:20:37 user devstack@n-api.service[61423]: request: DELETE /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d HTTP/1.1 Apr 11 17:20:37 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:20:37 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:20:37 user devstack@n-api.service[61423]: Connection: close Apr 11 17:20:37 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:20:37 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:20:37 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:20:37 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:20:37 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:20:37 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:20:37 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:20:37 user devstack@n-api.service[61423]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:20:37 user devstack@n-api.service[61423]: method: > Apr 11 17:20:37 user devstack@n-api.service[61423]: exception: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:20:37 user devstack@n-api.service[61423]: action_args: {'id': 'd0b8cd04-945b-4926-b7fb-b6c65ed0164d'} Apr 11 17:20:37 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:20:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-35b6f5d2-7dd4-4ff1-9fac-57180486eca0 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d" status: 404 len: 111 microversion: 2.1 time: 0.033078 Apr 11 17:20:37 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 275/828] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:20:37 2023] DELETE /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: d0b8cd04-945b-4926-b7fb-b6c65ed0164d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:20:37 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d HTTP/1.1 Apr 11 17:20:37 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:20:37 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:20:37 user devstack@n-api.service[61422]: Connection: close Apr 11 17:20:37 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:20:37 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:20:37 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:20:37 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:20:37 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:20:37 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61422]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:20:37 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:20:37 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:20:37 user devstack@n-api.service[61422]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:20:37 user devstack@n-api.service[61422]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:20:37 user devstack@n-api.service[61422]: method: > Apr 11 17:20:37 user devstack@n-api.service[61422]: exception: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:20:37 user devstack@n-api.service[61422]: action_args: {'id': 'd0b8cd04-945b-4926-b7fb-b6c65ed0164d'} Apr 11 17:20:37 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. Apr 11 17:20:37 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance d0b8cd04-945b-4926-b7fb-b6c65ed0164d could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:20:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-2fbf1b15-3b00-48f9-a16a-172686047e00 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d" status: 404 len: 111 microversion: 2.1 time: 0.032257 Apr 11 17:20:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 276/829] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:20:37 2023] GET /compute/v2.1/servers/d0b8cd04-945b-4926-b7fb-b6c65ed0164d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:37 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:20:37 user devstack@n-api.service[61424]: request: DELETE /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7 HTTP/1.1 Apr 11 17:20:37 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:20:37 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:20:37 user devstack@n-api.service[61424]: Connection: close Apr 11 17:20:37 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:20:37 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:20:37 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:20:37 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:20:37 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:20:37 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:20:37 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:20:37 user devstack@n-api.service[61424]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:20:37 user devstack@n-api.service[61424]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:20:37 user devstack@n-api.service[61424]: method: > Apr 11 17:20:37 user devstack@n-api.service[61424]: exception: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61424]: action_args: {'id': 'df974dc8-deda-4bdb-bb9d-1471bee040a7'} Apr 11 17:20:37 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:20:37 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-d58feeeb-1cf2-4da1-86cb-9f7211e21525 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7" status: 404 len: 111 microversion: 2.1 time: 0.029667 Apr 11 17:20:37 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 279/830] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:20:37 2023] DELETE /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: df974dc8-deda-4bdb-bb9d-1471bee040a7] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:20:37 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7 HTTP/1.1 Apr 11 17:20:37 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:20:37 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:20:37 user devstack@n-api.service[61423]: Connection: close Apr 11 17:20:37 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:20:37 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:20:37 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:20:37 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:20:37 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:20:37 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:20:37 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:20:37 user devstack@n-api.service[61423]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:20:37 user devstack@n-api.service[61423]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:20:37 user devstack@n-api.service[61423]: method: > Apr 11 17:20:37 user devstack@n-api.service[61423]: exception: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61423]: action_args: {'id': 'df974dc8-deda-4bdb-bb9d-1471bee040a7'} Apr 11 17:20:37 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. Apr 11 17:20:37 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:20:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance df974dc8-deda-4bdb-bb9d-1471bee040a7 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:20:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-6b3bc2b7-ee90-4d9b-9640-86132d57eb49 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7" status: 404 len: 111 microversion: 2.1 time: 0.029073 Apr 11 17:20:37 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 276/831] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:20:37 2023] GET /compute/v2.1/servers/df974dc8-deda-4bdb-bb9d-1471bee040a7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-fb8edcec-fb4b-4faf-a971-a4c5c7f5bfca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd835c60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-967443343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKIf8swPeQ8k3tVkxHzSQajnx5dZeeECr2jPVWCHomlXq+/pxB5Ji92d7YCQoG2qecjKO0zyeXONi4HqgHey+nD/tIc8qpWD8cDMK+h9qIIhtu7PGUdbUbdA89lnEULcg=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-fb8edcec-fb4b-4faf-a971-a4c5c7f5bfca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for project 631ee1e131e94577b853a5ae0886a318. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:20:37 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-fb8edcec-fb4b-4faf-a971-a4c5c7f5bfca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for user c7dcfe84c23f4c0aa80b8f287f0ab004 and project 631ee1e131e94577b853a5ae0886a318. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:20:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-fb8edcec-fb4b-4faf-a971-a4c5c7f5bfca tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.050546 Apr 11 17:20:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 277/832] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:20:37 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:20:40 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1788190556", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-967443343", "security_groups": [{"name": "tempest-secgroup-smoke-1559236648"}], "block_device_mapping_v2": [{"uuid": "17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e"}]}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:20:40 user devstack@n-api.service[61424]: DEBUG nova.network.neutron [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] validate_networks() for [('dd04c0b8-1ba3-450d-9eab-fd88096ba41e', None, None, None, None, None)] {{(pid=61424) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for user c7dcfe84c23f4c0aa80b8f287f0ab004 and project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Going to run 1 instances... {{(pid=61424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:20:41 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2',volume_size=None,volume_type=None)] {{(pid=61424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:20:41 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-73b04140-a812-498b-a773-4af6f0c1cb94 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.747236 Apr 11 17:20:41 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 280/833] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:20:40 2023] POST /compute/v2.1/servers => generated 404 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:20:41 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-62a767ff-a6a7-4294-99a5-fd5ba00c2c27 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:41 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-62a767ff-a6a7-4294-99a5-fd5ba00c2c27 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:41 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-62a767ff-a6a7-4294-99a5-fd5ba00c2c27 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:20:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-62a767ff-a6a7-4294-99a5-fd5ba00c2c27 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" status: 200 len: 1089 microversion: 2.1 time: 0.065394 Apr 11 17:20:41 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 277/834] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:20:41 2023] GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:20:43 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47", "tag": "8f15c555-6010-4fdf-b40d-c262a826acd4"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:20:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] Creating event network-changed:8f15c555-6010-4fdf-b40d-c262a826acd4 for instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 on user Apr 11 17:20:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-0ac39feb-f32d-4b03-aeb6-920ab69026a9 req-6a02ce96-ccf7-480e-8870-53d4beab66c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032549 Apr 11 17:20:44 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 278/835] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:20:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:20:45 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:45 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] [instance: 25935a69-292b-4d55-932c-f4893838998c] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:45 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:45 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:45 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:45 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:45 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:45 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:45 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] HTTP exception thrown: Instance 25935a69-292b-4d55-932c-f4893838998c could not be found. Apr 11 17:20:45 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Request method failure captured: Apr 11 17:20:45 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c HTTP/1.1 Apr 11 17:20:45 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:20:45 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:20:45 user devstack@n-api.service[61424]: Connection: close Apr 11 17:20:45 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:20:45 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:20:45 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:20:45 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:20:45 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZLG_8768-mQu9yCs4bl3OD1M7pFG45ape6z4ER5iPMh2_4MVeL8_JC_PQr_wQldSevDB4n3fAHGtPfGRkhDLtbmOK0lOZKqOM-mism8v_CCvVElUL8QJRBymW1T6rq6VlnL9Bw8r7y3LHYzyoUDFyNZbhaisWcl1Vc1hXgwyF33jcU Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Project-Id: 16e55c9209ac4b11b5af5ec1ad14d8b5 Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16e55c9209ac4b11b5af5ec1ad14d8b5"}]}] Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Tenant-Id: 16e55c9209ac4b11b5af5ec1ad14d8b5 Apr 11 17:20:45 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1553918933 Apr 11 17:20:45 user devstack@n-api.service[61424]: X-User: tempest-ServerRescueNegativeTestJSON-1553918933-project-member Apr 11 17:20:45 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:20:45 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:20:45 user devstack@n-api.service[61424]: X-User-Id: 3666d19053684843b400aab6ebf29cce Apr 11 17:20:45 user devstack@n-api.service[61424]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1553918933-project-member Apr 11 17:20:45 user devstack@n-api.service[61424]: method: > Apr 11 17:20:45 user devstack@n-api.service[61424]: exception: Instance 25935a69-292b-4d55-932c-f4893838998c could not be found. Apr 11 17:20:45 user devstack@n-api.service[61424]: action_args: {'id': '25935a69-292b-4d55-932c-f4893838998c'} Apr 11 17:20:45 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25935a69-292b-4d55-932c-f4893838998c could not be found. Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25935a69-292b-4d55-932c-f4893838998c could not be found. Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25935a69-292b-4d55-932c-f4893838998c could not be found. Apr 11 17:20:45 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:20:45 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] Returning 404 to user: Instance 25935a69-292b-4d55-932c-f4893838998c could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:20:45 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-59f49bfd-6366-4e6e-b7a1-dc82b5e1bea0 tempest-ServerRescueNegativeTestJSON-1553918933 tempest-ServerRescueNegativeTestJSON-1553918933-project-member] 10.0.0.210 "GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c" status: 404 len: 111 microversion: 2.1 time: 0.027855 Apr 11 17:20:45 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 281/836] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:20:45 2023] GET /compute/v2.1/servers/25935a69-292b-4d55-932c-f4893838998c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:20:49 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47", "name": "network-vif-plugged", "status": "completed", "tag": "8f15c555-6010-4fdf-b40d-c262a826acd4"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:20:49 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:49 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:49 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] Creating event network-vif-plugged:8f15c555-6010-4fdf-b40d-c262a826acd4 for instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 on user Apr 11 17:20:49 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-ed6cb8f1-a137-4ff6-918b-c4d50903a493 req-3693a824-927b-445e-82f6-c953589416e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041444 Apr 11 17:20:49 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 278/837] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:20:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:20:51 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:52 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47", "name": "network-vif-plugged", "status": "completed", "tag": "8f15c555-6010-4fdf-b40d-c262a826acd4"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:20:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] Creating event network-vif-plugged:8f15c555-6010-4fdf-b40d-c262a826acd4 for instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 on user Apr 11 17:20:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-77e3f792-b5fe-46e2-9386-32a2af799c9b req-c081ce48-b4f8-4637-9bfc-a90be4d9cc32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037719 Apr 11 17:20:52 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 279/838] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:20:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:20:54 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-778355250", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4"}]}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:20:54 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:54 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:54 user devstack@n-api.service[61424]: DEBUG nova.network.neutron [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] validate_networks() for [('5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4', None, None, None, None, None)] {{(pid=61424) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Flavor limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Image limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Flavor pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Image pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Getting quotas for project fd4d0572552242c69df31613597ed588. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Getting quotas for user aeef943ec0a0456da8e9b742385ac7f6 and project fd4d0572552242c69df31613597ed588. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Going to run 1 instances... {{(pid=61424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:20:55 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:20:55 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-1d26555d-eb4a-4e5f-8886-56d523a8f610 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.483914 Apr 11 17:20:55 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 282/839] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:20:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:20:55 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2132a70c-73ca-4cfa-b805-42eedd75dfb8 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:20:55 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2132a70c-73ca-4cfa-b805-42eedd75dfb8 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:20:55 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:20:55 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-2132a70c-73ca-4cfa-b805-42eedd75dfb8 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeef943ec0a0456da8e9b742385ac7f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4d0572552242c69df31613597ed588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:20:55 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2132a70c-73ca-4cfa-b805-42eedd75dfb8 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7426fa28-ae58-444f-b2f4-32b079cbaede" status: 200 len: 1207 microversion: 2.1 time: 0.065304 Apr 11 17:20:55 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 279/840] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:20:55 2023] GET /compute/v2.1/servers/7426fa28-ae58-444f-b2f4-32b079cbaede => generated 1207 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 17:20:57 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7426fa28-ae58-444f-b2f4-32b079cbaede", "tag": "255d0d03-b986-4328-917b-e54a4e1228be"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:20:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] Creating event network-changed:255d0d03-b986-4328-917b-e54a4e1228be for instance 7426fa28-ae58-444f-b2f4-32b079cbaede on user Apr 11 17:20:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-e52a445a-9e29-4918-91a1-13483cadbc4a req-dfe8fa4d-c57a-41e2-8f6c-9cc8ee70033d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034144 Apr 11 17:20:57 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 280/841] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:20:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:20:59 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7426fa28-ae58-444f-b2f4-32b079cbaede", "name": "network-vif-plugged", "status": "completed", "tag": "255d0d03-b986-4328-917b-e54a4e1228be"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:20:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:20:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:20:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:20:59 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] Creating event network-vif-plugged:255d0d03-b986-4328-917b-e54a4e1228be for instance 7426fa28-ae58-444f-b2f4-32b079cbaede on user Apr 11 17:20:59 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-d232bd0d-e61b-43a0-aa5d-6f67048cd3ae req-afbdb199-dc58-4d5a-8365-9945257a5fed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030636 Apr 11 17:20:59 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 283/842] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:20:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:01 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7426fa28-ae58-444f-b2f4-32b079cbaede", "name": "network-vif-plugged", "status": "completed", "tag": "255d0d03-b986-4328-917b-e54a4e1228be"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:01 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:01 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] Creating event network-vif-plugged:255d0d03-b986-4328-917b-e54a4e1228be for instance 7426fa28-ae58-444f-b2f4-32b079cbaede on user Apr 11 17:21:01 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-0db04160-f363-4bf7-895d-f74dce75f368 req-391a8670-5bb0-4719-8a8f-82a50ca930ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034146 Apr 11 17:21:01 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 280/843] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:03 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-80cc83d1-837b-4564-a0be-9e69d6dca48f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:03 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-80cc83d1-837b-4564-a0be-9e69d6dca48f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80cc83d1-837b-4564-a0be-9e69d6dca48f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80cc83d1-837b-4564-a0be-9e69d6dca48f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80cc83d1-837b-4564-a0be-9e69d6dca48f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80cc83d1-837b-4564-a0be-9e69d6dca48f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80cc83d1-837b-4564-a0be-9e69d6dca48f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-80cc83d1-837b-4564-a0be-9e69d6dca48f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:03 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-80cc83d1-837b-4564-a0be-9e69d6dca48f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050968 Apr 11 17:21:03 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 281/844] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 17:21:03 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:21:03 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:03 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:03 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:21:03 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c23672a5-0c0a-4794-9fd2-939b6e2c3ca2 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2" status: 204 len: 0 microversion: 2.20 time: 0.173058 Apr 11 17:21:03 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 284/845] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:21:03 2023] DELETE /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:21:03 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:03 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:03 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:04 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:04 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:04 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:04 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-d528d77b-6197-43d2-a753-8c3614d372b5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2" status: 200 len: 1712 microversion: 2.20 time: 0.243720 Apr 11 17:21:04 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 281/846] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:21:03 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 => generated 1712 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:21:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "name": "network-vif-unplugged", "status": "completed", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:04 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:04 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=21 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] Creating event network-vif-unplugged:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:21:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-e26be471-b742-400b-92c6-bef6ef7b3936 req-0ba70f36-734f-42e5-b243-a8cd6b1eecd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051192 Apr 11 17:21:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 282/847] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:06 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "name": "network-vif-plugged", "status": "completed", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}, {"server_uuid": "49e044ae-91af-4db8-b0fe-3679dd210ab2", "name": "network-vif-deleted", "tag": "4d7d89bc-13fc-41ae-b35c-618cc375d3b4"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:06 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:06 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:06 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:06 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:06 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] Creating event network-vif-plugged:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:21:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] Creating event network-vif-deleted:4d7d89bc-13fc-41ae-b35c-618cc375d3b4 for instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 on user Apr 11 17:21:06 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-ef7f9b3b-d2ae-45fb-a35a-205a27cbbe67 req-ecf1355c-2117-458f-93c1-a4eb31bfd1c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078569 Apr 11 17:21:06 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 285/848] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:07 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] HTTP exception thrown: Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 could not be found. Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Request method failure captured: Apr 11 17:21:07 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 HTTP/1.1 Apr 11 17:21:07 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:21:07 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:21:07 user devstack@n-api.service[61423]: Connection: close Apr 11 17:21:07 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:21:07 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:21:07 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:21:07 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:21:07 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLOBaGmRnaeVnmZd4zzSsr97oiTHar3R4pORYPnLZGGI9qAbyscMznGuFJTj4hVRmAROi0O9duAeTnO4FwPlzUUDSUZB-o33vXwG-aJub9l3nH1yj2kV1G44ZCd2LuZVU8yS9EUVZKCudxuqJQM0MRFfobfbgplHgg9V3OkeScae9A Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Project-Id: 361d59e2f9ac4a68a1a738cc3f2a9d14 Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}] Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Tenant-Id: 361d59e2f9ac4a68a1a738cc3f2a9d14 Apr 11 17:21:07 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:21:07 user devstack@n-api.service[61423]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member Apr 11 17:21:07 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:21:07 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:21:07 user devstack@n-api.service[61423]: X-User-Id: 79b5fefb1e9748b8bf51535099bf5327 Apr 11 17:21:07 user devstack@n-api.service[61423]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member Apr 11 17:21:07 user devstack@n-api.service[61423]: method: > Apr 11 17:21:07 user devstack@n-api.service[61423]: exception: Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 could not be found. Apr 11 17:21:07 user devstack@n-api.service[61423]: action_args: {'id': '85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8'} Apr 11 17:21:07 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 could not be found. Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 could not be found. Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 could not be found. Apr 11 17:21:07 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Returning 404 to user: Instance 85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:21:07 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-99149b92-7b73-44a6-9b58-919eec2f3cd8 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8" status: 404 len: 111 microversion: 2.87 time: 0.034588 Apr 11 17:21:07 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 282/849] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:21:07 2023] GET /compute/v2.1/servers/85c52a52-b9b8-4a2f-b508-fba9f8bbbeb8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:21:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:07 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:07 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:21:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8c1054a3-f9ff-474a-8173-e3ff80868ae5 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a" status: 204 len: 0 microversion: 2.87 time: 0.126495 Apr 11 17:21:07 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 283/850] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:21:07 2023] DELETE /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:07 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ea33795a-6b37-4101-930e-08ab98a0d349 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a" status: 200 len: 1697 microversion: 2.87 time: 0.348949 Apr 11 17:21:07 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 286/851] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:21:07 2023] GET /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a => generated 1697 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87483a2-cf0e-465c-b486-361aba4c613a", "name": "network-vif-unplugged", "status": "completed", "tag": "3e2ec196-65df-4e44-adfd-613978e38721"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=21 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:07 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:07 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] Creating event network-vif-unplugged:3e2ec196-65df-4e44-adfd-613978e38721 for instance d87483a2-cf0e-465c-b486-361aba4c613a on user Apr 11 17:21:07 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-ed7beab8-a416-4824-aa7b-0fc842e46949 req-629bb592-855b-4900-a788-d144dc69c575 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034250 Apr 11 17:21:07 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 283/852] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:08 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-8d6753d1-3b54-4768-bcd3-540d05eba8ca req-4a4af02c-6888-4360-a023-42200684a09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87483a2-cf0e-465c-b486-361aba4c613a", "name": "network-vif-deleted", "tag": "3e2ec196-65df-4e44-adfd-613978e38721"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8d6753d1-3b54-4768-bcd3-540d05eba8ca req-4a4af02c-6888-4360-a023-42200684a09e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8d6753d1-3b54-4768-bcd3-540d05eba8ca req-4a4af02c-6888-4360-a023-42200684a09e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8d6753d1-3b54-4768-bcd3-540d05eba8ca req-4a4af02c-6888-4360-a023-42200684a09e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-8d6753d1-3b54-4768-bcd3-540d05eba8ca req-4a4af02c-6888-4360-a023-42200684a09e service nova] Creating event network-vif-deleted:3e2ec196-65df-4e44-adfd-613978e38721 for instance d87483a2-cf0e-465c-b486-361aba4c613a on user Apr 11 17:21:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-8d6753d1-3b54-4768-bcd3-540d05eba8ca req-4a4af02c-6888-4360-a023-42200684a09e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038534 Apr 11 17:21:08 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 284/853] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:09 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1e1476a8-7c3b-4bf6-9fed-5b09dff758ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:09 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-1e1476a8-7c3b-4bf6-9fed-5b09dff758ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e1476a8-7c3b-4bf6-9fed-5b09dff758ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e1476a8-7c3b-4bf6-9fed-5b09dff758ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e1476a8-7c3b-4bf6-9fed-5b09dff758ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e1476a8-7c3b-4bf6-9fed-5b09dff758ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e1476a8-7c3b-4bf6-9fed-5b09dff758ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e1476a8-7c3b-4bf6-9fed-5b09dff758ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:09 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-1e1476a8-7c3b-4bf6-9fed-5b09dff758ca tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.088406 Apr 11 17:21:09 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 287/854] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:21:09 2023] GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/os-interface => generated 282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:09 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87483a2-cf0e-465c-b486-361aba4c613a", "name": "network-vif-plugged", "status": "completed", "tag": "3e2ec196-65df-4e44-adfd-613978e38721"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:09 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] Creating event network-vif-plugged:3e2ec196-65df-4e44-adfd-613978e38721 for instance d87483a2-cf0e-465c-b486-361aba4c613a on user Apr 11 17:21:09 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-ff2e49fb-0f58-42a1-a5e2-3ef485c673cf req-820b0478-0063-49d7-8a3b-3a476a2bcda9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028156 Apr 11 17:21:09 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 284/855] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c137af2c-8f71-4ffe-8828-6b1023a7096e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c137af2c-8f71-4ffe-8828-6b1023a7096e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c137af2c-8f71-4ffe-8828-6b1023a7096e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c137af2c-8f71-4ffe-8828-6b1023a7096e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c137af2c-8f71-4ffe-8828-6b1023a7096e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c137af2c-8f71-4ffe-8828-6b1023a7096e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c137af2c-8f71-4ffe-8828-6b1023a7096e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c137af2c-8f71-4ffe-8828-6b1023a7096e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c137af2c-8f71-4ffe-8828-6b1023a7096e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/ips" status: 200 len: 108 microversion: 2.1 time: 0.034364 Apr 11 17:21:10 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 285/856] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 17:21:10 2023] GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/ips => generated 108 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b9154d8-9977-4c02-89a1-26975750e0a5"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Invalid volume: volume 6b9154d8-9977-4c02-89a1-26975750e0a5 is already attached to instances: b5f9fe94-98f0-4094-8003-53c06cbfd5cb Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:21:10 user devstack@n-api.service[61424]: request: POST /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/os-volume_attachments HTTP/1.1 Apr 11 17:21:10 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:21:10 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:21:10 user devstack@n-api.service[61424]: Connection: close Apr 11 17:21:10 user devstack@n-api.service[61424]: Content-Length: 74 Apr 11 17:21:10 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:21:10 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:21:10 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:21:10 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:21:10 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:21:10 user devstack@n-api.service[61424]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:21:10 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:21:10 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:21:10 user devstack@n-api.service[61424]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:21:10 user devstack@n-api.service[61424]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:21:10 user devstack@n-api.service[61424]: Apr 11 17:21:10 user devstack@n-api.service[61424]: {"volumeAttachment": {"volumeId": "6b9154d8-9977-4c02-89a1-26975750e0a5"}} Apr 11 17:21:10 user devstack@n-api.service[61424]: method: > Apr 11 17:21:10 user devstack@n-api.service[61424]: exception: Invalid volume: volume 6b9154d8-9977-4c02-89a1-26975750e0a5 is already attached to instances: b5f9fe94-98f0-4094-8003-53c06cbfd5cb Apr 11 17:21:10 user devstack@n-api.service[61424]: action_args: {'server_id': '0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc', 'body': {'volumeAttachment': {'volumeId': '6b9154d8-9977-4c02-89a1-26975750e0a5'}}} Apr 11 17:21:10 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6b9154d8-9977-4c02-89a1-26975750e0a5 is already attached to instances: b5f9fe94-98f0-4094-8003-53c06cbfd5cb Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6b9154d8-9977-4c02-89a1-26975750e0a5 is already attached to instances: b5f9fe94-98f0-4094-8003-53c06cbfd5cb Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6b9154d8-9977-4c02-89a1-26975750e0a5 is already attached to instances: b5f9fe94-98f0-4094-8003-53c06cbfd5cb Apr 11 17:21:10 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 400 to user: Invalid volume: volume 6b9154d8-9977-4c02-89a1-26975750e0a5 is already attached to instances: b5f9fe94-98f0-4094-8003-53c06cbfd5cb {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:21:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-9d9e6f47-8c0b-4b78-88fa-2a1489aec33d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098945 Apr 11 17:21:10 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 288/857] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:21:10 2023] POST /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:21:10 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:10 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:21:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-1e0ee649-000c-4435-a82a-9149bda85a36 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" status: 204 len: 0 microversion: 2.1 time: 0.106313 Apr 11 17:21:10 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 285/858] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:21:10 2023] DELETE /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e448590d-c1c1-48f8-a017-2d058f005c87 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e448590d-c1c1-48f8-a017-2d058f005c87 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e448590d-c1c1-48f8-a017-2d058f005c87 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e448590d-c1c1-48f8-a017-2d058f005c87 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e448590d-c1c1-48f8-a017-2d058f005c87 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e448590d-c1c1-48f8-a017-2d058f005c87 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e448590d-c1c1-48f8-a017-2d058f005c87 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e448590d-c1c1-48f8-a017-2d058f005c87 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc", "tag": "714e84f4-64ee-4448-9681-881a322ec1a8"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] Creating event network-changed:714e84f4-64ee-4448-9681-881a322ec1a8 for instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc on user Apr 11 17:21:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-0ec9e4c8-019e-4a15-84de-ccf47648bf8e req-67d1da34-4b18-4bef-bab0-85e16c9db496 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033849 Apr 11 17:21:10 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 289/859] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:10 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-e448590d-c1c1-48f8-a017-2d058f005c87 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e448590d-c1c1-48f8-a017-2d058f005c87 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" status: 200 len: 1551 microversion: 2.1 time: 0.235911 Apr 11 17:21:10 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 286/860] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:21:10 2023] GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc => generated 1551 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:21:12 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-52aa341e-f7ec-4fca-803f-990c08254bd0 req-77e62bf7-2a30-4609-a2e2-d7a717ff41d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc", "name": "network-vif-deleted", "tag": "714e84f4-64ee-4448-9681-881a322ec1a8"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-52aa341e-f7ec-4fca-803f-990c08254bd0 req-77e62bf7-2a30-4609-a2e2-d7a717ff41d9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-52aa341e-f7ec-4fca-803f-990c08254bd0 req-77e62bf7-2a30-4609-a2e2-d7a717ff41d9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:12 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-52aa341e-f7ec-4fca-803f-990c08254bd0 req-77e62bf7-2a30-4609-a2e2-d7a717ff41d9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:12 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-52aa341e-f7ec-4fca-803f-990c08254bd0 req-77e62bf7-2a30-4609-a2e2-d7a717ff41d9 service nova] Creating event network-vif-deleted:714e84f4-64ee-4448-9681-881a322ec1a8 for instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc on user Apr 11 17:21:12 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-52aa341e-f7ec-4fca-803f-990c08254bd0 req-77e62bf7-2a30-4609-a2e2-d7a717ff41d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032050 Apr 11 17:21:12 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 286/861] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc", "name": "network-vif-unplugged", "status": "completed", "tag": "714e84f4-64ee-4448-9681-881a322ec1a8"}, {"server_uuid": "0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc", "name": "network-vif-plugged", "status": "completed", "tag": "714e84f4-64ee-4448-9681-881a322ec1a8"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Creating event network-vif-unplugged:714e84f4-64ee-4448-9681-881a322ec1a8 for instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc on user Apr 11 17:21:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] Creating event network-vif-plugged:714e84f4-64ee-4448-9681-881a322ec1a8 for instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc on user Apr 11 17:21:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-bd3872ce-0687-4d9a-a4c1-a95c20aed800 req-0dfb40aa-62cf-4aa5-8c72-1f77dd169a99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029446 Apr 11 17:21:12 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 290/862] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:12 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-0816b65c-93d9-42df-a8b5-69d9c8626e8e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:16 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-0816b65c-93d9-42df-a8b5-69d9c8626e8e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0816b65c-93d9-42df-a8b5-69d9c8626e8e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0816b65c-93d9-42df-a8b5-69d9c8626e8e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0816b65c-93d9-42df-a8b5-69d9c8626e8e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0816b65c-93d9-42df-a8b5-69d9c8626e8e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0816b65c-93d9-42df-a8b5-69d9c8626e8e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0816b65c-93d9-42df-a8b5-69d9c8626e8e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-0816b65c-93d9-42df-a8b5-69d9c8626e8e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.104562 Apr 11 17:21:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 287/863] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:21:16 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d/os-interface => generated 283 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70a306a5-f981-495f-9f3a-8fd5011b4ce1", "tag": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:17 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] Creating event network-changed:2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 on user Apr 11 17:21:17 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-66443a6d-8f78-4688-b12b-636934d6d0cd req-2f01d6a3-79a1-4409-9d63-f1645e6118e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027404 Apr 11 17:21:17 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 287/864] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:17 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-7d9d946f-00f3-4f95-b93f-f3e355919847 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:17 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-7d9d946f-00f3-4f95-b93f-f3e355919847 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7d9d946f-00f3-4f95-b93f-f3e355919847 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7d9d946f-00f3-4f95-b93f-f3e355919847 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7d9d946f-00f3-4f95-b93f-f3e355919847 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7d9d946f-00f3-4f95-b93f-f3e355919847 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7d9d946f-00f3-4f95-b93f-f3e355919847 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-7d9d946f-00f3-4f95-b93f-f3e355919847 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:17 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-7d9d946f-00f3-4f95-b93f-f3e355919847 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:17 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-7d9d946f-00f3-4f95-b93f-f3e355919847 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 200 len: 1428 microversion: 2.1 time: 0.190969 Apr 11 17:21:17 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 291/865] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:21:17 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 1428 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Old instance type m1.nano, new instance type m1.micro {{(pid=61422) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for project db242f5f39d94966948e8b487cd52d0c. Resources: {'cores', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Getting quotas for user 8f4ba7d7f3f74b5c800be2408c1035e2 and project db242f5f39d94966948e8b487cd52d0c. Resources: {'cores', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:21:17 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:21:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ac4357d0-201b-415e-bd17-21026d7c0932 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d/action" status: 202 len: 0 microversion: 2.1 time: 0.149507 Apr 11 17:21:17 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 288/866] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:21:17 2023] POST /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-d3d65541-283f-4c18-89aa-7c2eff228a32 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-d3d65541-283f-4c18-89aa-7c2eff228a32 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d3d65541-283f-4c18-89aa-7c2eff228a32 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d3d65541-283f-4c18-89aa-7c2eff228a32 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d3d65541-283f-4c18-89aa-7c2eff228a32 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d3d65541-283f-4c18-89aa-7c2eff228a32 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d3d65541-283f-4c18-89aa-7c2eff228a32 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-d3d65541-283f-4c18-89aa-7c2eff228a32 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:17 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-d3d65541-283f-4c18-89aa-7c2eff228a32 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:17 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-d3d65541-283f-4c18-89aa-7c2eff228a32 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 200 len: 1437 microversion: 2.1 time: 0.171452 Apr 11 17:21:17 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 288/867] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:21:17 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 1437 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:21:19 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40270cb6-8b7f-4658-8ea8-17a800d63f2d", "tag": "09360ccd-e24b-449a-9e15-b86a5a12b501"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:19 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] Creating event network-changed:09360ccd-e24b-449a-9e15-b86a5a12b501 for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d on user Apr 11 17:21:19 user devstack@n-api.service[61424]: DEBUG nova.compute.api [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61424) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:21:19 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-9ace0a13-9749-4889-93fd-4c864c69eb7b req-f17a0d33-29ce-497d-95de-40978cf2efb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049854 Apr 11 17:21:19 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 292/868] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40270cb6-8b7f-4658-8ea8-17a800d63f2d", "name": "network-vif-unplugged", "status": "completed", "tag": "09360ccd-e24b-449a-9e15-b86a5a12b501"}, {"server_uuid": "40270cb6-8b7f-4658-8ea8-17a800d63f2d", "name": "network-vif-plugged", "status": "completed", "tag": "09360ccd-e24b-449a-9e15-b86a5a12b501"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Creating event network-vif-unplugged:09360ccd-e24b-449a-9e15-b86a5a12b501 for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d on user Apr 11 17:21:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Creating event network-vif-plugged:09360ccd-e24b-449a-9e15-b86a5a12b501 for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d on user Apr 11 17:21:21 user devstack@n-api.service[61422]: DEBUG nova.compute.api [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61422) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:21:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-fff926a5-c77a-4fa0-a425-0b3b259c0b70 req-3e716f4c-16b2-4f68-a832-6e4a99226089 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.053311 Apr 11 17:21:21 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 289/869] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:21 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40270cb6-8b7f-4658-8ea8-17a800d63f2d", "name": "network-vif-plugged", "status": "completed", "tag": "09360ccd-e24b-449a-9e15-b86a5a12b501"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:30 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:30 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] Creating event network-vif-plugged:09360ccd-e24b-449a-9e15-b86a5a12b501 for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d on user Apr 11 17:21:30 user devstack@n-api.service[61423]: DEBUG nova.compute.api [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61423) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:21:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-0388ba46-41a7-43fe-b90d-a0556b641f27 req-498d9831-352d-4dc6-b993-956ed45989a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061260 Apr 11 17:21:30 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 289/870] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:31 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=15 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:31 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=29 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-b1dd9ed1-2771-452b-a411-7b99141705b1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:31 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-b1dd9ed1-2771-452b-a411-7b99141705b1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1dd9ed1-2771-452b-a411-7b99141705b1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1dd9ed1-2771-452b-a411-7b99141705b1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1dd9ed1-2771-452b-a411-7b99141705b1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1dd9ed1-2771-452b-a411-7b99141705b1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1dd9ed1-2771-452b-a411-7b99141705b1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b1dd9ed1-2771-452b-a411-7b99141705b1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:31 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-b1dd9ed1-2771-452b-a411-7b99141705b1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-b1dd9ed1-2771-452b-a411-7b99141705b1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" status: 200 len: 1441 microversion: 2.1 time: 0.162262 Apr 11 17:21:31 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 293/871] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:21:31 2023] GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 => generated 1441 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:21:32 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:32 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:32 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:32 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40270cb6-8b7f-4658-8ea8-17a800d63f2d", "name": "network-vif-plugged", "status": "completed", "tag": "09360ccd-e24b-449a-9e15-b86a5a12b501"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:32 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] Creating event network-vif-plugged:09360ccd-e24b-449a-9e15-b86a5a12b501 for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d on user Apr 11 17:21:32 user devstack@n-api.service[61422]: DEBUG nova.compute.api [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61422) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 17:21:32 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-fe8e149e-9817-497d-a983-5010b4497655 req-35703b90-d449-4106-9ce5-4d3971008e93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064432 Apr 11 17:21:32 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 290/872] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:34 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e8023eac-b4f7-4422-9e7d-7f0101cf744b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-236225711"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:34 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e8023eac-b4f7-4422-9e7d-7f0101cf744b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e8023eac-b4f7-4422-9e7d-7f0101cf744b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e8023eac-b4f7-4422-9e7d-7f0101cf744b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e8023eac-b4f7-4422-9e7d-7f0101cf744b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e8023eac-b4f7-4422-9e7d-7f0101cf744b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e8023eac-b4f7-4422-9e7d-7f0101cf744b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e8023eac-b4f7-4422-9e7d-7f0101cf744b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:34 user devstack@n-api.service[61423]: INFO nova.network.security_group_api [None req-e8023eac-b4f7-4422-9e7d-7f0101cf744b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Removing security group 1f3acf80-5fb5-460e-a8a0-9cf47f0ee4cc from port ef4e04c8-3073-425e-a10b-ca224239fd2f Apr 11 17:21:34 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e8023eac-b4f7-4422-9e7d-7f0101cf744b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/action" status: 202 len: 0 microversion: 2.1 time: 0.626089 Apr 11 17:21:34 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 290/873] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:21:34 2023] POST /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:21:34 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:34 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] Creating event network-changed:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:21:34 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-8e25eef3-44d6-484c-894a-7850a0c6b474 req-2bf97458-7263-40a4-bb27-cf8e9b9e7557 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033519 Apr 11 17:21:34 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 294/874] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:35 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:35 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] Creating event network-changed:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:21:35 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-75016de5-b5c4-4f9a-b241-72b41ea42047 req-872ef1a7-4a92-4a6a-b497-66719b79c5c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043584 Apr 11 17:21:35 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 291/875] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:35 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:36 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'services' on Instance uuid 9bf98306-a141-480b-97c0-6fdd7931b8f6 {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:21:36 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ffb056f8-1057-4360-a827-f4c5673a757d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/os-volume_attachments/d97aa7e6-492f-4a89-9305-d2c10afa79a6" status: 202 len: 0 microversion: 2.1 time: 0.190785 Apr 11 17:21:36 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 291/876] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:21:35 2023] DELETE /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/os-volume_attachments/d97aa7e6-492f-4a89-9305-d2c10afa79a6 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:21:36 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-089307fe-660c-4229-beb6-456c668078c5 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:36 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-089307fe-660c-4229-beb6-456c668078c5 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-089307fe-660c-4229-beb6-456c668078c5 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-089307fe-660c-4229-beb6-456c668078c5 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-089307fe-660c-4229-beb6-456c668078c5 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-089307fe-660c-4229-beb6-456c668078c5 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-089307fe-660c-4229-beb6-456c668078c5 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-089307fe-660c-4229-beb6-456c668078c5 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:36 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-089307fe-660c-4229-beb6-456c668078c5 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Apr 11 17:21:36 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 295/877] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:21:36 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:21:45 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-85d4f57b-791e-4c40-b8e7-9be2962d0cfb tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:45 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-85d4f57b-791e-4c40-b8e7-9be2962d0cfb tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-85d4f57b-791e-4c40-b8e7-9be2962d0cfb tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-85d4f57b-791e-4c40-b8e7-9be2962d0cfb tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-85d4f57b-791e-4c40-b8e7-9be2962d0cfb tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-85d4f57b-791e-4c40-b8e7-9be2962d0cfb tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-85d4f57b-791e-4c40-b8e7-9be2962d0cfb tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-85d4f57b-791e-4c40-b8e7-9be2962d0cfb tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:45 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-85d4f57b-791e-4c40-b8e7-9be2962d0cfb tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeef943ec0a0456da8e9b742385ac7f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4d0572552242c69df31613597ed588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:45 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-85d4f57b-791e-4c40-b8e7-9be2962d0cfb tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7426fa28-ae58-444f-b2f4-32b079cbaede" status: 200 len: 1485 microversion: 2.1 time: 0.150744 Apr 11 17:21:45 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 292/878] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:21:45 2023] GET /compute/v2.1/servers/7426fa28-ae58-444f-b2f4-32b079cbaede => generated 1485 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] HTTP exception thrown: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Request method failure captured: Apr 11 17:21:54 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 HTTP/1.1 Apr 11 17:21:54 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:21:54 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:21:54 user devstack@n-api.service[61423]: Connection: close Apr 11 17:21:54 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:21:54 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:21:54 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:21:54 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:21:54 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZV6qdu8jsEV9INPt_i9pG5yjipeDWfyeQO51QRwL4Wn4mv6yT9fgJwwoAxERgaM-XKCmNZB_y1Py-t0kZfRKSvoWg_hcVZtRBwvIE561lWxMwF_cDLTlaVX9m1WMlc4Q_n9gnsxLZIXYwHCQ9cU02V_lZW2Z0PM9MJsOoxxte4yzDk Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Project-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fce268052b8046e5a7efa41048e96645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}] Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Tenant-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:21:54 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:21:54 user devstack@n-api.service[61423]: X-User: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:21:54 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:21:54 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:21:54 user devstack@n-api.service[61423]: X-User-Id: b69069a1461d485598e2078cc12772a5 Apr 11 17:21:54 user devstack@n-api.service[61423]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:21:54 user devstack@n-api.service[61423]: method: > Apr 11 17:21:54 user devstack@n-api.service[61423]: exception: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:21:54 user devstack@n-api.service[61423]: action_args: {'id': '49e044ae-91af-4db8-b0fe-3679dd210ab2'} Apr 11 17:21:54 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:21:54 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:21:54 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Returning 404 to user: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:21:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-847e6fc3-3ab7-4591-8089-d05831b28929 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2" status: 404 len: 111 microversion: 2.20 time: 0.037636 Apr 11 17:21:54 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 292/879] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:21:54 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:21:54 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3e69ad6f-95be-45da-b3ff-50bb5911e438 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '.version_select at 0x7f5bdc613be0>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:54 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:54 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=14 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:54 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-3e69ad6f-95be-45da-b3ff-50bb5911e438 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-385713192" status: 204 len: 0 microversion: 2.20 time: 0.027873 Apr 11 17:21:54 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 296/880] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 11 17:21:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-385713192 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:21:54 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-40366e55-e4d6-4001-ba9d-637b20d7fd70 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd6f5bd0>, body: {"keypair": {"name": "tempest-keypair-1845823024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBER06UAVi3Q++YC5IiYnLZmfsdNe0rK6icCcgHlC03GX/fdzJHXoeYyuwz1vL6kQvN/1agaN7Felkq60IsaoEVHWhTREOURBecopzDJIXKfwl1FISMDpgIfn5xEca/pyRw=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:54 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-40366e55-e4d6-4001-ba9d-637b20d7fd70 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting quotas for project fce268052b8046e5a7efa41048e96645. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:21:54 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-40366e55-e4d6-4001-ba9d-637b20d7fd70 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting quotas for user b69069a1461d485598e2078cc12772a5 and project fce268052b8046e5a7efa41048e96645. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:21:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-40366e55-e4d6-4001-ba9d-637b20d7fd70 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048957 Apr 11 17:21:54 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 293/881] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 17:21:54 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 17:21:56 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1970963305", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ab158a7f-12de-4735-97b5-6ffa89762d09"}], "security_groups": [{"name": "tempest-securitygroup--1292656614"}], "key_name": "tempest-keypair-1845823024", "user_data": "}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:56 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] validate_networks() for [('ab158a7f-12de-4735-97b5-6ffa89762d09', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:21:56 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:21:56 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:21:56 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:21:56 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:21:56 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting quotas for project fce268052b8046e5a7efa41048e96645. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Getting quotas for user b69069a1461d485598e2078cc12772a5 and project fce268052b8046e5a7efa41048e96645. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:21:57 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-b4731b27-06ad-4b51-ac19-8ac4c88ab9c7 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.561837 Apr 11 17:21:57 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 293/882] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 17:21:56 2023] POST /compute/v2.1/servers => generated 400 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 17:21:57 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-d8a8595d-d96a-4e5a-8f01-65821c0c461c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:57 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-d8a8595d-d96a-4e5a-8f01-65821c0c461c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:57 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-d8a8595d-d96a-4e5a-8f01-65821c0c461c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:57 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-d8a8595d-d96a-4e5a-8f01-65821c0c461c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:57 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-d8a8595d-d96a-4e5a-8f01-65821c0c461c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:57 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-d8a8595d-d96a-4e5a-8f01-65821c0c461c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8" status: 200 len: 1276 microversion: 2.20 time: 0.067469 Apr 11 17:21:57 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 297/883] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:21:57 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => generated 1276 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 17:21:57 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=12 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:21:57 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:57 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: d87483a2-cf0e-465c-b486-361aba4c613a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] HTTP exception thrown: Instance d87483a2-cf0e-465c-b486-361aba4c613a could not be found. Apr 11 17:21:57 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Request method failure captured: Apr 11 17:21:57 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a HTTP/1.1 Apr 11 17:21:57 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:21:57 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:21:57 user devstack@n-api.service[61422]: Connection: close Apr 11 17:21:57 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:21:57 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:21:57 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:21:57 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:21:57 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLOBaGmRnaeVnmZd4zzSsr97oiTHar3R4pORYPnLZGGI9qAbyscMznGuFJTj4hVRmAROi0O9duAeTnO4FwPlzUUDSUZB-o33vXwG-aJub9l3nH1yj2kV1G44ZCd2LuZVU8yS9EUVZKCudxuqJQM0MRFfobfbgplHgg9V3OkeScae9A Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Project-Id: 361d59e2f9ac4a68a1a738cc3f2a9d14 Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}] Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Tenant-Id: 361d59e2f9ac4a68a1a738cc3f2a9d14 Apr 11 17:21:57 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:21:57 user devstack@n-api.service[61422]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member Apr 11 17:21:57 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:21:57 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:21:57 user devstack@n-api.service[61422]: X-User-Id: 79b5fefb1e9748b8bf51535099bf5327 Apr 11 17:21:57 user devstack@n-api.service[61422]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member Apr 11 17:21:57 user devstack@n-api.service[61422]: method: > Apr 11 17:21:57 user devstack@n-api.service[61422]: exception: Instance d87483a2-cf0e-465c-b486-361aba4c613a could not be found. Apr 11 17:21:57 user devstack@n-api.service[61422]: action_args: {'id': 'd87483a2-cf0e-465c-b486-361aba4c613a'} Apr 11 17:21:57 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87483a2-cf0e-465c-b486-361aba4c613a could not be found. Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87483a2-cf0e-465c-b486-361aba4c613a could not be found. Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87483a2-cf0e-465c-b486-361aba4c613a could not be found. Apr 11 17:21:57 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:21:57 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Returning 404 to user: Instance d87483a2-cf0e-465c-b486-361aba4c613a could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:21:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d57cc409-3e55-427e-863b-4414f88181a7 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a" status: 404 len: 111 microversion: 2.87 time: 0.031526 Apr 11 17:21:57 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 294/884] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:21:57 2023] GET /compute/v2.1/servers/d87483a2-cf0e-465c-b486-361aba4c613a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:57 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:21:58 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-a89a997e-6ecf-4250-97b0-d5a29c7ba159 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02" status: 204 len: 0 microversion: 2.87 time: 0.112000 Apr 11 17:21:58 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 294/885] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:21:57 2023] DELETE /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:21:58 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:21:58 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:21:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:58 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:58 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:58 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:58 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:21:58 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-0c2e205d-d85f-46f2-87ca-d16283dfcc89 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02" status: 200 len: 1775 microversion: 2.87 time: 0.254490 Apr 11 17:21:58 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 298/886] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:21:58 2023] GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02 => generated 1775 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:21:58 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-unplugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] Creating event network-vif-unplugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:21:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-450454ee-48a1-4ab1-ab35-8737a60f2b06 req-3f4f656a-a03d-4e3c-a72a-1a1c709b91fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036543 Apr 11 17:21:58 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 295/887] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:21:59 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:21:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:21:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:21:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:21:59 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] Creating event network-changed:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:21:59 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-d381c164-e6bb-4a07-b717-69b1d0fd6760 req-ba79186f-bc30-4630-a226-c82367094e88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033605 Apr 11 17:21:59 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 295/888] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:21:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:00 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-plugged", "status": "completed", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}, {"server_uuid": "1289fdf8-8842-4e16-80dc-a287bc08fb02", "name": "network-vif-deleted", "tag": "67d00c4b-a9a1-4ac1-8df9-e7fd43a17056"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:00 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] Creating event network-vif-plugged:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:22:00 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] Creating event network-vif-deleted:67d00c4b-a9a1-4ac1-8df9-e7fd43a17056 for instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 on user Apr 11 17:22:00 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-42cc8640-960d-45f1-830b-a82e67827aec req-c6705bfd-6984-4a48-979c-13405b0cc053 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031535 Apr 11 17:22:00 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 299/889] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:22:01 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc HTTP/1.1 Apr 11 17:22:01 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:22:01 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:22:01 user devstack@n-api.service[61422]: Connection: close Apr 11 17:22:01 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:22:01 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:22:01 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:22:01 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:22:01 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:22:01 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:22:01 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:22:01 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:22:01 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:22:01 user devstack@n-api.service[61422]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:22:01 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:22:01 user devstack@n-api.service[61422]: method: > Apr 11 17:22:01 user devstack@n-api.service[61422]: exception: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:22:01 user devstack@n-api.service[61422]: action_args: {'id': '0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc'} Apr 11 17:22:01 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:22:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:22:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9b469725-3e29-4944-8fda-3a367802f424 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" status: 404 len: 111 microversion: 2.1 time: 0.033250 Apr 11 17:22:01 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 296/890] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:22:01 2023] GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:22:01 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ef756ec4-3efa-4a0d-a262-b78caf3fd0ae tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '.version_select at 0x7f5bdd7d0f70>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:01 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ef756ec4-3efa-4a0d-a262-b78caf3fd0ae tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1047793130" status: 202 len: 0 microversion: 2.1 time: 0.022552 Apr 11 17:22:01 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 296/891] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 17:22:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1047793130 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:22:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:01 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:01 user devstack@n-api.service[61424]: DEBUG nova.objects.instance [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'services' on Instance uuid b5f9fe94-98f0-4094-8003-53c06cbfd5cb {{(pid=61424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:22:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-95631375-0961-472c-848b-3680be58c87b tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/os-volume_attachments/6b9154d8-9977-4c02-89a1-26975750e0a5" status: 202 len: 0 microversion: 2.1 time: 0.182910 Apr 11 17:22:01 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 300/892] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:22:01 2023] DELETE /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/os-volume_attachments/6b9154d8-9977-4c02-89a1-26975750e0a5 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b4293700-f6af-48ff-b09f-c3d71000eb35 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-b4293700-f6af-48ff-b09f-c3d71000eb35 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b4293700-f6af-48ff-b09f-c3d71000eb35 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b4293700-f6af-48ff-b09f-c3d71000eb35 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b4293700-f6af-48ff-b09f-c3d71000eb35 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b4293700-f6af-48ff-b09f-c3d71000eb35 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b4293700-f6af-48ff-b09f-c3d71000eb35 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b4293700-f6af-48ff-b09f-c3d71000eb35 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b4293700-f6af-48ff-b09f-c3d71000eb35 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059677 Apr 11 17:22:01 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 297/893] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:22:01 2023] GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:02 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "name": "network-vif-plugged", "status": "completed", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:02 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:02 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] Creating event network-vif-plugged:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:22:02 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-3deb40b4-8a5f-4742-8166-9ef8faab5b85 req-53a7ee74-49a9-49f8-ba97-89a9050efc8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032270 Apr 11 17:22:02 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 297/894] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:04 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "name": "network-vif-plugged", "status": "completed", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:04 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] Creating event network-vif-plugged:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:22:04 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-8b1f79b0-9e98-4384-b17f-7394bd729f1b req-d9ecc0e7-84f5-4136-95fb-3bffa34f4fb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028519 Apr 11 17:22:04 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 301/895] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ac9e6837-a82e-430e-85d6-247001b4b0a0 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:07 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ac9e6837-a82e-430e-85d6-247001b4b0a0 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:07 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:07 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac9e6837-a82e-430e-85d6-247001b4b0a0 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac9e6837-a82e-430e-85d6-247001b4b0a0 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac9e6837-a82e-430e-85d6-247001b4b0a0 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac9e6837-a82e-430e-85d6-247001b4b0a0 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac9e6837-a82e-430e-85d6-247001b4b0a0 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ac9e6837-a82e-430e-85d6-247001b4b0a0 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:08 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ac9e6837-a82e-430e-85d6-247001b4b0a0 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ac9e6837-a82e-430e-85d6-247001b4b0a0 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 200 len: 1554 microversion: 2.1 time: 0.146631 Apr 11 17:22:08 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 298/896] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:22:07 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-79f0389e-7844-4a5d-8fb2-8328a3c9b68b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-79f0389e-7844-4a5d-8fb2-8328a3c9b68b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79f0389e-7844-4a5d-8fb2-8328a3c9b68b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79f0389e-7844-4a5d-8fb2-8328a3c9b68b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79f0389e-7844-4a5d-8fb2-8328a3c9b68b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79f0389e-7844-4a5d-8fb2-8328a3c9b68b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79f0389e-7844-4a5d-8fb2-8328a3c9b68b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:26 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-79f0389e-7844-4a5d-8fb2-8328a3c9b68b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:26 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-79f0389e-7844-4a5d-8fb2-8328a3c9b68b tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049185 Apr 11 17:22:26 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 298/897] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:22:26 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] HTTP exception thrown: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 is not attached to volume d97aa7e6-492f-4a89-9305-d2c10afa79a6 Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Request method failure captured: Apr 11 17:22:26 user devstack@n-api.service[61424]: request: DELETE /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/os-volume_attachments/d97aa7e6-492f-4a89-9305-d2c10afa79a6 HTTP/1.1 Apr 11 17:22:26 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:22:26 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:22:26 user devstack@n-api.service[61424]: Connection: close Apr 11 17:22:26 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:22:26 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:22:26 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:22:26 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:22:26 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZYlhmC2oiI6gawAcJGuGfhGnknZ5_xndVlxiBUaQ3wKzuhK4fXibdfH7ZQS_-TN5Szk3SxPMXMnqqbwxxD6ZscmqYMTGl2T0NIK5iZcohVwGGZz6gaUn0krHMhPcd7SmQGQLJe-WjRRr2-_j2Cj8_lU7tYmQyPUfMvs40eq-Xle0Fs Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Project-Id: ab7ce3fc251f4f1eb9151d1ef8c86d91 Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Project-Name: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}] Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Tenant: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Tenant-Id: ab7ce3fc251f4f1eb9151d1ef8c86d91 Apr 11 17:22:26 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:22:26 user devstack@n-api.service[61424]: X-User: tempest-TestMinimumBasicScenario-593818068-project-member Apr 11 17:22:26 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:22:26 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:22:26 user devstack@n-api.service[61424]: X-User-Id: eed61e2d73a84d85a9f5ff2b314624c9 Apr 11 17:22:26 user devstack@n-api.service[61424]: X-User-Name: tempest-TestMinimumBasicScenario-593818068-project-member Apr 11 17:22:26 user devstack@n-api.service[61424]: method: > Apr 11 17:22:26 user devstack@n-api.service[61424]: exception: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 is not attached to volume d97aa7e6-492f-4a89-9305-d2c10afa79a6 Apr 11 17:22:26 user devstack@n-api.service[61424]: action_args: {'server_id': '9bf98306-a141-480b-97c0-6fdd7931b8f6', 'id': 'd97aa7e6-492f-4a89-9305-d2c10afa79a6'} Apr 11 17:22:26 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d97aa7e6-492f-4a89-9305-d2c10afa79a6. Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 is not attached to volume d97aa7e6-492f-4a89-9305-d2c10afa79a6 Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 is not attached to volume d97aa7e6-492f-4a89-9305-d2c10afa79a6 Apr 11 17:22:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:22:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Returning 404 to user: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 is not attached to volume d97aa7e6-492f-4a89-9305-d2c10afa79a6 {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:22:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-b59f06c6-4606-4f4f-947a-b9492867dcde tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/os-volume_attachments/d97aa7e6-492f-4a89-9305-d2c10afa79a6" status: 404 len: 154 microversion: 2.1 time: 0.105518 Apr 11 17:22:26 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 302/898] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:22:26 2023] DELETE /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6/os-volume_attachments/d97aa7e6-492f-4a89-9305-d2c10afa79a6 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:22:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:27 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:27 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:27 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=18 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:27 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:22:27 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-19af7b3a-7a95-4dbf-be91-c124bceff432 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6" status: 204 len: 0 microversion: 2.1 time: 0.110104 Apr 11 17:22:27 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 299/899] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:22:27 2023] DELETE /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:22:27 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2c4f1e67-470e-4725-9cf3-8c155a355c69 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:27 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2c4f1e67-470e-4725-9cf3-8c155a355c69 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c4f1e67-470e-4725-9cf3-8c155a355c69 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c4f1e67-470e-4725-9cf3-8c155a355c69 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c4f1e67-470e-4725-9cf3-8c155a355c69 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c4f1e67-470e-4725-9cf3-8c155a355c69 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c4f1e67-470e-4725-9cf3-8c155a355c69 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:27 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c4f1e67-470e-4725-9cf3-8c155a355c69 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:27 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-2c4f1e67-470e-4725-9cf3-8c155a355c69 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:27 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2c4f1e67-470e-4725-9cf3-8c155a355c69 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6" status: 200 len: 1542 microversion: 2.1 time: 0.166600 Apr 11 17:22:27 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 299/900] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:22:27 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 => generated 1542 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:22:27 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "name": "network-vif-unplugged", "status": "completed", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:27 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] Creating event network-vif-unplugged:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:22:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-a3f1b251-5307-43fa-a9c7-7a4822c29b08 req-62946f8d-748b-43a4-8889-9e606f97f811 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031316 Apr 11 17:22:27 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 303/901] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:22:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-d58d8758-e41c-4487-be84-ac4041523e75 req-be0cf0d1-1547-414c-a099-198cb314670e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "name": "network-vif-deleted", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d58d8758-e41c-4487-be84-ac4041523e75 req-be0cf0d1-1547-414c-a099-198cb314670e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d58d8758-e41c-4487-be84-ac4041523e75 req-be0cf0d1-1547-414c-a099-198cb314670e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d58d8758-e41c-4487-be84-ac4041523e75 req-be0cf0d1-1547-414c-a099-198cb314670e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-d58d8758-e41c-4487-be84-ac4041523e75 req-be0cf0d1-1547-414c-a099-198cb314670e service nova] Creating event network-vif-deleted:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:22:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-d58d8758-e41c-4487-be84-ac4041523e75 req-be0cf0d1-1547-414c-a099-198cb314670e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029281 Apr 11 17:22:29 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 300/902] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:29 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf98306-a141-480b-97c0-6fdd7931b8f6", "name": "network-vif-plugged", "status": "completed", "tag": "ef4e04c8-3073-425e-a10b-ca224239fd2f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] Creating event network-vif-plugged:ef4e04c8-3073-425e-a10b-ca224239fd2f for instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 on user Apr 11 17:22:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-a4b5224f-6305-4751-8f12-412d388188a7 req-b17e9963-56e5-4d7a-80b7-86200eb88c9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031570 Apr 11 17:22:30 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 300/903] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-12eeac73-168a-4f48-9c17-94fe325ccd20 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:31 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-12eeac73-168a-4f48-9c17-94fe325ccd20 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-12eeac73-168a-4f48-9c17-94fe325ccd20 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-12eeac73-168a-4f48-9c17-94fe325ccd20 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-12eeac73-168a-4f48-9c17-94fe325ccd20 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-12eeac73-168a-4f48-9c17-94fe325ccd20 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-12eeac73-168a-4f48-9c17-94fe325ccd20 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-12eeac73-168a-4f48-9c17-94fe325ccd20 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:31 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-12eeac73-168a-4f48-9c17-94fe325ccd20 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-12eeac73-168a-4f48-9c17-94fe325ccd20 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" status: 200 len: 1441 microversion: 2.1 time: 0.144252 Apr 11 17:22:31 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 304/904] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:22:31 2023] GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 => generated 1441 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:22:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47", "tag": "8f15c555-6010-4fdf-b40d-c262a826acd4"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] Creating event network-changed:8f15c555-6010-4fdf-b40d-c262a826acd4 for instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 on user Apr 11 17:22:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-2d8e6250-5814-4db8-a5f1-05be5868d644 req-5da6900e-e57a-497c-9c98-acce05c2d616 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028451 Apr 11 17:22:33 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 301/905] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:34 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:34 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:34 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:22:34 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-434109af-f68a-4d0e-93a5-b46812626610 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" status: 204 len: 0 microversion: 2.1 time: 0.112580 Apr 11 17:22:34 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 301/906] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:22:34 2023] DELETE /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:22:35 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-75a06079-f914-4a1e-9908-580aeffe84fb tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:35 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-75a06079-f914-4a1e-9908-580aeffe84fb tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75a06079-f914-4a1e-9908-580aeffe84fb tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75a06079-f914-4a1e-9908-580aeffe84fb tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75a06079-f914-4a1e-9908-580aeffe84fb tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75a06079-f914-4a1e-9908-580aeffe84fb tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75a06079-f914-4a1e-9908-580aeffe84fb tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-75a06079-f914-4a1e-9908-580aeffe84fb tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:35 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-75a06079-f914-4a1e-9908-580aeffe84fb tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-75a06079-f914-4a1e-9908-580aeffe84fb tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" status: 200 len: 1565 microversion: 2.1 time: 0.178745 Apr 11 17:22:35 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 305/907] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:22:34 2023] GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:22:35 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47", "name": "network-vif-unplugged", "status": "completed", "tag": "8f15c555-6010-4fdf-b40d-c262a826acd4"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:35 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] Creating event network-vif-unplugged:8f15c555-6010-4fdf-b40d-c262a826acd4 for instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 on user Apr 11 17:22:35 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-2ef93973-22ae-4d0a-a893-35012918dac9 req-34c12f82-0030-40a8-9e65-c03efa2592ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031509 Apr 11 17:22:35 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 302/908] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47", "name": "network-vif-plugged", "status": "completed", "tag": "8f15c555-6010-4fdf-b40d-c262a826acd4"}, {"server_uuid": "4e53bfed-5cf9-47c1-ae70-63b89a7f8d47", "name": "network-vif-deleted", "tag": "8f15c555-6010-4fdf-b40d-c262a826acd4"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] Creating event network-vif-plugged:8f15c555-6010-4fdf-b40d-c262a826acd4 for instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 on user Apr 11 17:22:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] Creating event network-vif-deleted:8f15c555-6010-4fdf-b40d-c262a826acd4 for instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 on user Apr 11 17:22:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-d81e167d-f0ef-47be-a9dd-b7c722bddf53 req-5f756735-8663-4527-a2d2-bec71e54179d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044572 Apr 11 17:22:37 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 302/909] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:46 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:46 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:46 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=8 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:46 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=20 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:46 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:46 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:22:46 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-1aab03aa-446f-4ab9-a7b8-31872aeea4ab tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7426fa28-ae58-444f-b2f4-32b079cbaede" status: 204 len: 0 microversion: 2.1 time: 0.198543 Apr 11 17:22:46 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 306/910] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:22:46 2023] DELETE /compute/v2.1/servers/7426fa28-ae58-444f-b2f4-32b079cbaede => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:22:46 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:46 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:22:46 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e8aa42d3-ad46-4109-9dbf-10d587fefbe2 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:46 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e8aa42d3-ad46-4109-9dbf-10d587fefbe2 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8aa42d3-ad46-4109-9dbf-10d587fefbe2 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8aa42d3-ad46-4109-9dbf-10d587fefbe2 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8aa42d3-ad46-4109-9dbf-10d587fefbe2 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8aa42d3-ad46-4109-9dbf-10d587fefbe2 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8aa42d3-ad46-4109-9dbf-10d587fefbe2 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8aa42d3-ad46-4109-9dbf-10d587fefbe2 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:46 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-e8aa42d3-ad46-4109-9dbf-10d587fefbe2 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeef943ec0a0456da8e9b742385ac7f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4d0572552242c69df31613597ed588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:46 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e8aa42d3-ad46-4109-9dbf-10d587fefbe2 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7426fa28-ae58-444f-b2f4-32b079cbaede" status: 200 len: 1491 microversion: 2.1 time: 0.189834 Apr 11 17:22:46 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 303/911] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:22:46 2023] GET /compute/v2.1/servers/7426fa28-ae58-444f-b2f4-32b079cbaede => generated 1491 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:22:46 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7426fa28-ae58-444f-b2f4-32b079cbaede", "name": "network-vif-unplugged", "status": "completed", "tag": "255d0d03-b986-4328-917b-e54a4e1228be"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:46 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:46 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] Creating event network-vif-unplugged:255d0d03-b986-4328-917b-e54a4e1228be for instance 7426fa28-ae58-444f-b2f4-32b079cbaede on user Apr 11 17:22:46 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-4c244e81-cce2-42c5-9e47-bc8b3788646d req-97c20db2-ade3-4f88-a620-dce94a253080 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037202 Apr 11 17:22:46 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 303/912] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:46 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:47 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:47 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:47 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:47 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:47 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-d8f4b82b-72af-4182-95e2-1da0161c05c3 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8" status: 200 len: 1588 microversion: 2.20 time: 0.184623 Apr 11 17:22:47 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 307/913] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:22:47 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => generated 1588 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:22:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-f1f0702a-297b-4c95-9e15-d36d6619faf4 req-8181c626-f26f-463e-947f-8e32592679de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7426fa28-ae58-444f-b2f4-32b079cbaede", "name": "network-vif-deleted", "tag": "255d0d03-b986-4328-917b-e54a4e1228be"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f1f0702a-297b-4c95-9e15-d36d6619faf4 req-8181c626-f26f-463e-947f-8e32592679de service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f1f0702a-297b-4c95-9e15-d36d6619faf4 req-8181c626-f26f-463e-947f-8e32592679de service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f1f0702a-297b-4c95-9e15-d36d6619faf4 req-8181c626-f26f-463e-947f-8e32592679de service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-f1f0702a-297b-4c95-9e15-d36d6619faf4 req-8181c626-f26f-463e-947f-8e32592679de service nova] Creating event network-vif-deleted:255d0d03-b986-4328-917b-e54a4e1228be for instance 7426fa28-ae58-444f-b2f4-32b079cbaede on user Apr 11 17:22:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-f1f0702a-297b-4c95-9e15-d36d6619faf4 req-8181c626-f26f-463e-947f-8e32592679de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028030 Apr 11 17:22:47 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 304/914] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 1289fdf8-8842-4e16-80dc-a287bc08fb02] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] HTTP exception thrown: Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 could not be found. Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Request method failure captured: Apr 11 17:22:48 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02 HTTP/1.1 Apr 11 17:22:48 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:22:48 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:22:48 user devstack@n-api.service[61423]: Connection: close Apr 11 17:22:48 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:22:48 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:22:48 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:22:48 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:22:48 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLOBaGmRnaeVnmZd4zzSsr97oiTHar3R4pORYPnLZGGI9qAbyscMznGuFJTj4hVRmAROi0O9duAeTnO4FwPlzUUDSUZB-o33vXwG-aJub9l3nH1yj2kV1G44ZCd2LuZVU8yS9EUVZKCudxuqJQM0MRFfobfbgplHgg9V3OkeScae9A Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Project-Id: 361d59e2f9ac4a68a1a738cc3f2a9d14 Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}] Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Tenant-Id: 361d59e2f9ac4a68a1a738cc3f2a9d14 Apr 11 17:22:48 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:22:48 user devstack@n-api.service[61423]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member Apr 11 17:22:48 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:22:48 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:22:48 user devstack@n-api.service[61423]: X-User-Id: 79b5fefb1e9748b8bf51535099bf5327 Apr 11 17:22:48 user devstack@n-api.service[61423]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member Apr 11 17:22:48 user devstack@n-api.service[61423]: method: > Apr 11 17:22:48 user devstack@n-api.service[61423]: exception: Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 could not be found. Apr 11 17:22:48 user devstack@n-api.service[61423]: action_args: {'id': '1289fdf8-8842-4e16-80dc-a287bc08fb02'} Apr 11 17:22:48 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 could not be found. Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 could not be found. Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 could not be found. Apr 11 17:22:48 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Returning 404 to user: Instance 1289fdf8-8842-4e16-80dc-a287bc08fb02 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:22:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-5707d06c-62f5-4316-8b1d-98371679ec82 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02" status: 404 len: 111 microversion: 2.87 time: 0.036786 Apr 11 17:22:48 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 304/915] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:22:48 2023] GET /compute/v2.1/servers/1289fdf8-8842-4e16-80dc-a287bc08fb02 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:22:48 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:48 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:48 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7426fa28-ae58-444f-b2f4-32b079cbaede", "name": "network-vif-plugged", "status": "completed", "tag": "255d0d03-b986-4328-917b-e54a4e1228be"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:48 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:22:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] Creating event network-vif-plugged:255d0d03-b986-4328-917b-e54a4e1228be for instance 7426fa28-ae58-444f-b2f4-32b079cbaede on user Apr 11 17:22:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-ef354cd9-26cd-419c-9161-51bbe26a0760 req-e7cf9ccb-59d1-4473-8fcb-a3c518e31589 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028319 Apr 11 17:22:48 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 305/916] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:48 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-cf126408-cddd-47f1-aea9-5fbd303e519a tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b" status: 204 len: 0 microversion: 2.87 time: 0.121495 Apr 11 17:22:48 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 308/917] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:22:48 2023] DELETE /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:48 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79b5fefb1e9748b8bf51535099bf5327', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '361d59e2f9ac4a68a1a738cc3f2a9d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-b422ee0b-e7af-475e-904e-536c39b9e090 tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b" status: 200 len: 1697 microversion: 2.87 time: 0.178414 Apr 11 17:22:48 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 305/918] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:22:48 2023] GET /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:22:49 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05988541-51cb-4e52-912e-ddf2b773db6b", "name": "network-vif-unplugged", "status": "completed", "tag": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf"}, {"server_uuid": "05988541-51cb-4e52-912e-ddf2b773db6b", "name": "network-vif-plugged", "status": "completed", "tag": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:49 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Creating event network-vif-unplugged:f4ebd413-5243-4c27-8dc3-91a5991d3ecf for instance 05988541-51cb-4e52-912e-ddf2b773db6b on user Apr 11 17:22:49 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] Creating event network-vif-plugged:f4ebd413-5243-4c27-8dc3-91a5991d3ecf for instance 05988541-51cb-4e52-912e-ddf2b773db6b on user Apr 11 17:22:49 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-b0b81ae1-1556-4149-b71c-7b15b6f81a73 req-f5763bdd-f330-441a-99bf-11db7142e06b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029787 Apr 11 17:22:49 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 306/919] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:49 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:51 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-8d1a8db8-b2cb-49a5-a0e3-56be5bbd8bc8 req-ec6ee3bd-32b6-43b2-965f-cf414388a8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05988541-51cb-4e52-912e-ddf2b773db6b", "name": "network-vif-deleted", "tag": "f4ebd413-5243-4c27-8dc3-91a5991d3ecf"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8d1a8db8-b2cb-49a5-a0e3-56be5bbd8bc8 req-ec6ee3bd-32b6-43b2-965f-cf414388a8fa service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8d1a8db8-b2cb-49a5-a0e3-56be5bbd8bc8 req-ec6ee3bd-32b6-43b2-965f-cf414388a8fa service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8d1a8db8-b2cb-49a5-a0e3-56be5bbd8bc8 req-ec6ee3bd-32b6-43b2-965f-cf414388a8fa service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:51 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8d1a8db8-b2cb-49a5-a0e3-56be5bbd8bc8 req-ec6ee3bd-32b6-43b2-965f-cf414388a8fa service nova] Creating event network-vif-deleted:f4ebd413-5243-4c27-8dc3-91a5991d3ecf for instance 05988541-51cb-4e52-912e-ddf2b773db6b on user Apr 11 17:22:51 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-8d1a8db8-b2cb-49a5-a0e3-56be5bbd8bc8 req-ec6ee3bd-32b6-43b2-965f-cf414388a8fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040358 Apr 11 17:22:51 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 309/920] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:52 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-de1aa24a-20d6-470e-b5a2-680a6f11c0ea tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:52 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-de1aa24a-20d6-470e-b5a2-680a6f11c0ea tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:52 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1aa24a-20d6-470e-b5a2-680a6f11c0ea tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:52 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1aa24a-20d6-470e-b5a2-680a6f11c0ea tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:52 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1aa24a-20d6-470e-b5a2-680a6f11c0ea tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:52 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1aa24a-20d6-470e-b5a2-680a6f11c0ea tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:52 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1aa24a-20d6-470e-b5a2-680a6f11c0ea tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:52 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1aa24a-20d6-470e-b5a2-680a6f11c0ea tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:52 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-de1aa24a-20d6-470e-b5a2-680a6f11c0ea tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.187845 Apr 11 17:22:52 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 306/921] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:22:51 2023] GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb/os-volume_attachments => generated 25 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:22:52 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:52 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:52 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:22:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9a483709-14c3-4127-8f09-9029ab15bc1c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb" status: 204 len: 0 microversion: 2.1 time: 0.121678 Apr 11 17:22:52 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 307/922] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:22:52 2023] DELETE /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:22:52 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c153bb97-1fe5-484b-9edd-9898b13641a8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:22:52 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c153bb97-1fe5-484b-9edd-9898b13641a8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:22:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c153bb97-1fe5-484b-9edd-9898b13641a8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c153bb97-1fe5-484b-9edd-9898b13641a8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c153bb97-1fe5-484b-9edd-9898b13641a8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c153bb97-1fe5-484b-9edd-9898b13641a8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c153bb97-1fe5-484b-9edd-9898b13641a8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c153bb97-1fe5-484b-9edd-9898b13641a8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:52 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-c153bb97-1fe5-484b-9edd-9898b13641a8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:22:52 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c153bb97-1fe5-484b-9edd-9898b13641a8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb" status: 200 len: 1670 microversion: 2.1 time: 0.169740 Apr 11 17:22:52 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 310/923] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:22:52 2023] GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:22:53 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f9fe94-98f0-4094-8003-53c06cbfd5cb", "name": "network-vif-unplugged", "status": "completed", "tag": "4ec17eb0-1b20-4679-9900-3fa2850b50b8"}, {"server_uuid": "b5f9fe94-98f0-4094-8003-53c06cbfd5cb", "name": "network-vif-plugged", "status": "completed", "tag": "4ec17eb0-1b20-4679-9900-3fa2850b50b8"}, {"server_uuid": "b5f9fe94-98f0-4094-8003-53c06cbfd5cb", "name": "network-vif-plugged", "status": "completed", "tag": "4ec17eb0-1b20-4679-9900-3fa2850b50b8"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Creating event network-vif-unplugged:4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb on user Apr 11 17:22:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Creating event network-vif-plugged:4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb on user Apr 11 17:22:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] Creating event network-vif-plugged:4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb on user Apr 11 17:22:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-bf1b349b-88b5-48a6-8e5b-cd610b73e14d req-43c896c8-315e-4263-a9b6-90999f23d890 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034472 Apr 11 17:22:54 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 307/924] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:53 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:22:56 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5f9fe94-98f0-4094-8003-53c06cbfd5cb", "name": "network-vif-plugged", "status": "completed", "tag": "4ec17eb0-1b20-4679-9900-3fa2850b50b8"}, {"server_uuid": "b5f9fe94-98f0-4094-8003-53c06cbfd5cb", "name": "network-vif-unplugged", "status": "completed", "tag": "4ec17eb0-1b20-4679-9900-3fa2850b50b8"}, {"server_uuid": "b5f9fe94-98f0-4094-8003-53c06cbfd5cb", "name": "network-vif-plugged", "status": "completed", "tag": "4ec17eb0-1b20-4679-9900-3fa2850b50b8"}, {"server_uuid": "b5f9fe94-98f0-4094-8003-53c06cbfd5cb", "name": "network-vif-deleted", "tag": "4ec17eb0-1b20-4679-9900-3fa2850b50b8"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:22:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:22:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:22:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:22:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Creating event network-vif-plugged:4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb on user Apr 11 17:22:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Creating event network-vif-unplugged:4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb on user Apr 11 17:22:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Creating event network-vif-plugged:4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb on user Apr 11 17:22:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] Creating event network-vif-deleted:4ec17eb0-1b20-4679-9900-3fa2850b50b8 for instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb on user Apr 11 17:22:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-9230428d-2680-4aa6-838e-3e8db213d714 req-53ed7a6d-5270-4317-988b-682ae96cec2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.031512 Apr 11 17:22:56 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 308/925] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:22:56 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:08 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:08 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:08 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:08 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:08 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:08 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ccdf5fdf-1be0-4967-8e15-551056dfdef4 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d/action" status: 204 len: 0 microversion: 2.1 time: 0.075337 Apr 11 17:23:08 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 311/926] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:23:08 2023] POST /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:23:08 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:08 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:08 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-4a4e4560-45f4-4deb-8dae-af1c3ac6243b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:08 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-4a4e4560-45f4-4deb-8dae-af1c3ac6243b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4a4e4560-45f4-4deb-8dae-af1c3ac6243b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4a4e4560-45f4-4deb-8dae-af1c3ac6243b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4a4e4560-45f4-4deb-8dae-af1c3ac6243b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4a4e4560-45f4-4deb-8dae-af1c3ac6243b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4a4e4560-45f4-4deb-8dae-af1c3ac6243b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:08 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4a4e4560-45f4-4deb-8dae-af1c3ac6243b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:08 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-4a4e4560-45f4-4deb-8dae-af1c3ac6243b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:23:08 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-4a4e4560-45f4-4deb-8dae-af1c3ac6243b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 200 len: 1554 microversion: 2.1 time: 0.180554 Apr 11 17:23:08 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 308/927] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:23:08 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:23:17 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:17 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:18 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:18 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 9bf98306-a141-480b-97c0-6fdd7931b8f6] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:18 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] HTTP exception thrown: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 could not be found. Apr 11 17:23:18 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Request method failure captured: Apr 11 17:23:18 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 HTTP/1.1 Apr 11 17:23:18 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:23:18 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:23:18 user devstack@n-api.service[61422]: Connection: close Apr 11 17:23:18 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:23:18 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:23:18 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:23:18 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:23:18 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZYlhmC2oiI6gawAcJGuGfhGnknZ5_xndVlxiBUaQ3wKzuhK4fXibdfH7ZQS_-TN5Szk3SxPMXMnqqbwxxD6ZscmqYMTGl2T0NIK5iZcohVwGGZz6gaUn0krHMhPcd7SmQGQLJe-WjRRr2-_j2Cj8_lU7tYmQyPUfMvs40eq-Xle0Fs Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Project-Id: ab7ce3fc251f4f1eb9151d1ef8c86d91 Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Project-Name: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}] Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Tenant: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Tenant-Id: ab7ce3fc251f4f1eb9151d1ef8c86d91 Apr 11 17:23:18 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:23:18 user devstack@n-api.service[61422]: X-User: tempest-TestMinimumBasicScenario-593818068-project-member Apr 11 17:23:18 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:23:18 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:23:18 user devstack@n-api.service[61422]: X-User-Id: eed61e2d73a84d85a9f5ff2b314624c9 Apr 11 17:23:18 user devstack@n-api.service[61422]: X-User-Name: tempest-TestMinimumBasicScenario-593818068-project-member Apr 11 17:23:18 user devstack@n-api.service[61422]: method: > Apr 11 17:23:18 user devstack@n-api.service[61422]: exception: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 could not be found. Apr 11 17:23:18 user devstack@n-api.service[61422]: action_args: {'id': '9bf98306-a141-480b-97c0-6fdd7931b8f6'} Apr 11 17:23:18 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 could not be found. Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 could not be found. Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 could not be found. Apr 11 17:23:18 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:23:18 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Returning 404 to user: Instance 9bf98306-a141-480b-97c0-6fdd7931b8f6 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:23:18 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-145ad15a-69c2-4adf-b806-5c0a44ea82be tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6" status: 404 len: 111 microversion: 2.1 time: 0.185773 Apr 11 17:23:18 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 309/928] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:23:17 2023] GET /compute/v2.1/servers/9bf98306-a141-480b-97c0-6fdd7931b8f6 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:23:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-806c6acd-7dfa-4973-b3bb-9224100a8b96 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '.version_select at 0x7f5bdd8e0790>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-806c6acd-7dfa-4973-b3bb-9224100a8b96 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1224626118" status: 202 len: 0 microversion: 2.1 time: 0.026578 Apr 11 17:23:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 312/929] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 11 17:23:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1224626118 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:23:20 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e4146d57-0385-4b16-a984-ce17e4cc68d7 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd8d43a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1538973025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiu9qs/8o9kvPO8W0Ojte7aOyHvHP1DL9rJi5LT5sMYD56u8SdO3IgkaWMqrP4DE0Bx/YMDMssf23hFHZssiVzqDM3Ta2uifIuvMqB1k9eG/UXvBn0IVBogGXgha1c2JQ=="}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:20 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:20 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:20 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-e4146d57-0385-4b16-a984-ce17e4cc68d7 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting quotas for project ab7ce3fc251f4f1eb9151d1ef8c86d91. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:23:20 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-e4146d57-0385-4b16-a984-ce17e4cc68d7 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting quotas for user eed61e2d73a84d85a9f5ff2b314624c9 and project ab7ce3fc251f4f1eb9151d1ef8c86d91. Resources: {'key_pairs'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:23:20 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e4146d57-0385-4b16-a984-ce17e4cc68d7 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.043336 Apr 11 17:23:20 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 309/930] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:23:20 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1524069267", "imageRef": "137b317a-9b41-43a6-8479-f72f88cdf361", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1538973025", "networks": [{"uuid": "e8339c3d-c984-4d1a-b01d-b64e5aec1392"}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] validate_networks() for [('e8339c3d-c984-4d1a-b01d-b64e5aec1392', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting quotas for project ab7ce3fc251f4f1eb9151d1ef8c86d91. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Getting quotas for user eed61e2d73a84d85a9f5ff2b314624c9 and project ab7ce3fc251f4f1eb9151d1ef8c86d91. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:23:20 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='137b317a-9b41-43a6-8479-f72f88cdf361',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:23:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-2523e418-0eec-42d0-b3cf-df0cebe722db tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.621316 Apr 11 17:23:21 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 310/931] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:23:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:23:21 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:21 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-302d491f-4001-4259-91ff-c542629396dd tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:21 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-302d491f-4001-4259-91ff-c542629396dd tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:21 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-302d491f-4001-4259-91ff-c542629396dd tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:23:21 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-302d491f-4001-4259-91ff-c542629396dd tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53" status: 200 len: 1253 microversion: 2.1 time: 0.072381 Apr 11 17:23:21 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 313/932] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:23:21 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 => generated 1253 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:23:23 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:23 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] Creating event network-changed:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:23:23 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-2cac8421-1683-4112-b065-1afb483a3e26 req-9002a648-ae3b-4ae8-bceb-a040d81e631a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029140 Apr 11 17:23:23 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 310/933] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:25 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:23:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:23:25 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 HTTP/1.1 Apr 11 17:23:25 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:23:25 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:23:25 user devstack@n-api.service[61422]: Connection: close Apr 11 17:23:25 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:23:25 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:23:25 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:23:25 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:23:25 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:23:25 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:23:25 user devstack@n-api.service[61422]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:23:25 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:23:25 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:23:25 user devstack@n-api.service[61422]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:23:25 user devstack@n-api.service[61422]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:23:25 user devstack@n-api.service[61422]: method: > Apr 11 17:23:25 user devstack@n-api.service[61422]: exception: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:23:25 user devstack@n-api.service[61422]: action_args: {'id': '4e53bfed-5cf9-47c1-ae70-63b89a7f8d47'} Apr 11 17:23:25 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:23:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:23:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:23:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-06e2ce7b-69d8-42de-ad7f-c37fe2ead3ef tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" status: 404 len: 111 microversion: 2.1 time: 0.214853 Apr 11 17:23:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 311/934] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:23:25 2023] GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:23:25 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-633641942", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-967443343", "security_groups": [{"name": "tempest-secgroup-smoke-1559236648"}], "block_device_mapping_v2": [{"uuid": "17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e"}]}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:25 user devstack@n-api.service[61424]: DEBUG nova.network.neutron [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] validate_networks() for [('dd04c0b8-1ba3-450d-9eab-fd88096ba41e', None, None, None, None, None)] {{(pid=61424) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for user c7dcfe84c23f4c0aa80b8f287f0ab004 and project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Going to run 1 instances... {{(pid=61424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:23:26 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17189ed1-c9b5-4fa7-a2de-0c06e5ecbbc2',volume_size=None,volume_type=None)] {{(pid=61424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:23:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-99455d7f-3fb8-4bd1-b0df-9fbea5dbd6c5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.859812 Apr 11 17:23:26 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 314/935] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:23:25 2023] POST /compute/v2.1/servers => generated 404 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:23:26 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-7d996ca4-98a2-41b5-bc6f-1c7c666857b9 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:26 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-7d996ca4-98a2-41b5-bc6f-1c7c666857b9 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:26 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "name": "network-vif-plugged", "status": "completed", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] Creating event network-vif-plugged:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:23:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-6609c1a5-a91c-4ab7-9b10-c3102b75acdf req-611c811b-e004-4d08-8c52-a43ebe71061d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045858 Apr 11 17:23:26 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 312/936] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:26 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-7d996ca4-98a2-41b5-bc6f-1c7c666857b9 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:23:26 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-7d996ca4-98a2-41b5-bc6f-1c7c666857b9 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210" status: 200 len: 1088 microversion: 2.1 time: 0.113440 Apr 11 17:23:26 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 311/937] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:23:26 2023] GET /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210 => generated 1088 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:23:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "name": "network-vif-plugged", "status": "completed", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] Creating event network-vif-plugged:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:23:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-1c0908c9-f8de-471d-83b4-a7089aa37022 req-b9e7923f-1810-44a3-9a4f-974205054ab3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038559 Apr 11 17:23:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 315/938] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f054c2a-84ad-48a6-ad76-8aaf5038c210", "tag": "56ae4ea0-6935-4111-9767-36f6e5d04d93"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] Creating event network-changed:56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 on user Apr 11 17:23:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-292acf29-149f-4384-a67c-9e1b7688a0c7 req-cfd2124e-da8c-49c8-a663-f2dc3a6a7ab0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033121 Apr 11 17:23:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 313/939] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:34 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f054c2a-84ad-48a6-ad76-8aaf5038c210", "name": "network-vif-plugged", "status": "completed", "tag": "56ae4ea0-6935-4111-9767-36f6e5d04d93"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:34 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:34 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] Creating event network-vif-plugged:56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 on user Apr 11 17:23:34 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-32f191e3-4f19-40a0-be07-30cf3fe42dc0 req-69a399ee-f4e6-4be4-afd9-5f304fb6382f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033435 Apr 11 17:23:34 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 312/940] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=8 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 7426fa28-ae58-444f-b2f4-32b079cbaede] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:36 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] HTTP exception thrown: Instance 7426fa28-ae58-444f-b2f4-32b079cbaede could not be found. Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Request method failure captured: Apr 11 17:23:36 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/7426fa28-ae58-444f-b2f4-32b079cbaede HTTP/1.1 Apr 11 17:23:36 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:23:36 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:23:36 user devstack@n-api.service[61424]: Connection: close Apr 11 17:23:36 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:23:36 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:23:36 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:23:36 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:23:36 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZb15Bt7WpHxxdXE3ugu8HlFn7CKrkEFjrh3z6UxPE89htARC3brLgobRezTGUpiyzbYCkqFsTHWE1aX8L_BhDyCIZ-bJh6JVbyXnAJ310ZzGdVV_VHH2HMoLzsack_eASiRzlK6w_6hIvMtNFxcUyusZN6xOrxCigELTN9UIOIxsrw Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Project-Id: fd4d0572552242c69df31613597ed588 Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Project-Name: tempest-VolumesActionsTest-815942062 Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd4d0572552242c69df31613597ed588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd4d0572552242c69df31613597ed588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd4d0572552242c69df31613597ed588"}]}] Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Tenant: tempest-VolumesActionsTest-815942062 Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Tenant-Id: fd4d0572552242c69df31613597ed588 Apr 11 17:23:36 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-VolumesActionsTest-815942062 Apr 11 17:23:36 user devstack@n-api.service[61424]: X-User: tempest-VolumesActionsTest-815942062-project-member Apr 11 17:23:36 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:23:36 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:23:36 user devstack@n-api.service[61424]: X-User-Id: aeef943ec0a0456da8e9b742385ac7f6 Apr 11 17:23:36 user devstack@n-api.service[61424]: X-User-Name: tempest-VolumesActionsTest-815942062-project-member Apr 11 17:23:36 user devstack@n-api.service[61424]: method: > Apr 11 17:23:36 user devstack@n-api.service[61424]: exception: Instance 7426fa28-ae58-444f-b2f4-32b079cbaede could not be found. Apr 11 17:23:36 user devstack@n-api.service[61424]: action_args: {'id': '7426fa28-ae58-444f-b2f4-32b079cbaede'} Apr 11 17:23:36 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7426fa28-ae58-444f-b2f4-32b079cbaede could not be found. Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7426fa28-ae58-444f-b2f4-32b079cbaede could not be found. Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7426fa28-ae58-444f-b2f4-32b079cbaede could not be found. Apr 11 17:23:36 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:23:36 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Returning 404 to user: Instance 7426fa28-ae58-444f-b2f4-32b079cbaede could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:23:36 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-654b9ae6-40c3-403e-8b5b-64a6da344cc1 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7426fa28-ae58-444f-b2f4-32b079cbaede" status: 404 len: 111 microversion: 2.1 time: 0.041499 Apr 11 17:23:36 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 316/941] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:23:36 2023] GET /compute/v2.1/servers/7426fa28-ae58-444f-b2f4-32b079cbaede => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:23:36 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:36 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:36 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-806119957", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "networks": [{"uuid": "5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4"}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:36 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] validate_networks() for [('5c7bc0b6-4e51-4ba4-992e-8b97769eb5f4', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:23:37 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f054c2a-84ad-48a6-ad76-8aaf5038c210", "name": "network-vif-plugged", "status": "completed", "tag": "56ae4ea0-6935-4111-9767-36f6e5d04d93"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] Creating event network-vif-plugged:56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 on user Apr 11 17:23:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-3db96f20-d98a-45c7-974d-b3310239ab91 req-a9ae7ecd-dfbd-4cd8-872b-2fba6db62fec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031886 Apr 11 17:23:37 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 313/942] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Getting quotas for project fd4d0572552242c69df31613597ed588. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Getting quotas for user aeef943ec0a0456da8e9b742385ac7f6 and project fd4d0572552242c69df31613597ed588. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:23:37 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:23:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7f43f4a0-9840-4dd2-94a9-94af62bae4e0 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.716604 Apr 11 17:23:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 314/943] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:23:36 2023] POST /compute/v2.1/servers => generated 378 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:23:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-950101f6-add0-4ef3-b82c-83aba06c0733 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:37 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-950101f6-add0-4ef3-b82c-83aba06c0733 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:37 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-950101f6-add0-4ef3-b82c-83aba06c0733 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeef943ec0a0456da8e9b742385ac7f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4d0572552242c69df31613597ed588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:23:37 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-950101f6-add0-4ef3-b82c-83aba06c0733 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d496845-40fd-4062-91e7-693c7db8a4f3" status: 200 len: 1207 microversion: 2.1 time: 0.088670 Apr 11 17:23:37 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 317/944] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:23:37 2023] GET /compute/v2.1/servers/8d496845-40fd-4062-91e7-693c7db8a4f3 => generated 1207 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:23:38 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:38 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] [instance: 05988541-51cb-4e52-912e-ddf2b773db6b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:38 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] HTTP exception thrown: Instance 05988541-51cb-4e52-912e-ddf2b773db6b could not be found. Apr 11 17:23:38 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Request method failure captured: Apr 11 17:23:38 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b HTTP/1.1 Apr 11 17:23:38 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:23:38 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:23:38 user devstack@n-api.service[61423]: Connection: close Apr 11 17:23:38 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:23:38 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:23:38 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:23:38 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:23:38 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLOBaGmRnaeVnmZd4zzSsr97oiTHar3R4pORYPnLZGGI9qAbyscMznGuFJTj4hVRmAROi0O9duAeTnO4FwPlzUUDSUZB-o33vXwG-aJub9l3nH1yj2kV1G44ZCd2LuZVU8yS9EUVZKCudxuqJQM0MRFfobfbgplHgg9V3OkeScae9A Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Project-Id: 361d59e2f9ac4a68a1a738cc3f2a9d14 Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/361d59e2f9ac4a68a1a738cc3f2a9d14"}]}] Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Tenant-Id: 361d59e2f9ac4a68a1a738cc3f2a9d14 Apr 11 17:23:38 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675 Apr 11 17:23:38 user devstack@n-api.service[61423]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member Apr 11 17:23:38 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:23:38 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:23:38 user devstack@n-api.service[61423]: X-User-Id: 79b5fefb1e9748b8bf51535099bf5327 Apr 11 17:23:38 user devstack@n-api.service[61423]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member Apr 11 17:23:38 user devstack@n-api.service[61423]: method: > Apr 11 17:23:38 user devstack@n-api.service[61423]: exception: Instance 05988541-51cb-4e52-912e-ddf2b773db6b could not be found. Apr 11 17:23:38 user devstack@n-api.service[61423]: action_args: {'id': '05988541-51cb-4e52-912e-ddf2b773db6b'} Apr 11 17:23:38 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05988541-51cb-4e52-912e-ddf2b773db6b could not be found. Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05988541-51cb-4e52-912e-ddf2b773db6b could not be found. Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05988541-51cb-4e52-912e-ddf2b773db6b could not be found. Apr 11 17:23:38 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:23:38 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] Returning 404 to user: Instance 05988541-51cb-4e52-912e-ddf2b773db6b could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:23:38 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-5096d5f0-23b9-42b6-b06c-2ee8e82f5cbc tempest-ServerBootFromVolumeStableRescueTest-1329171675 tempest-ServerBootFromVolumeStableRescueTest-1329171675-project-member] 10.0.0.210 "GET /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b" status: 404 len: 111 microversion: 2.87 time: 0.034176 Apr 11 17:23:38 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 314/945] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:23:38 2023] GET /compute/v2.1/servers/05988541-51cb-4e52-912e-ddf2b773db6b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:23:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d496845-40fd-4062-91e7-693c7db8a4f3", "tag": "4cd65e38-8f39-42d1-b015-f1a6679549b7"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] Creating event network-changed:4cd65e38-8f39-42d1-b015-f1a6679549b7 for instance 8d496845-40fd-4062-91e7-693c7db8a4f3 on user Apr 11 17:23:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-f3e1ad85-6612-46c2-8ea2-4adaf5f781b4 req-b7ac5047-a269-48ad-8a5f-804b3ab730c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030504 Apr 11 17:23:40 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 315/946] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:42 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d496845-40fd-4062-91e7-693c7db8a4f3", "name": "network-vif-plugged", "status": "completed", "tag": "4cd65e38-8f39-42d1-b015-f1a6679549b7"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:42 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] Creating event network-vif-plugged:4cd65e38-8f39-42d1-b015-f1a6679549b7 for instance 8d496845-40fd-4062-91e7-693c7db8a4f3 on user Apr 11 17:23:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-c33cf837-a0e9-4d48-be2e-7a3acbfa98b7 req-dafa8508-d00d-45e8-9a47-7bae7a2a8251 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039410 Apr 11 17:23:42 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 318/947] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:42 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:42 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:42 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:23:42 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:23:42 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb HTTP/1.1 Apr 11 17:23:42 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:23:42 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:23:42 user devstack@n-api.service[61423]: Connection: close Apr 11 17:23:42 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:23:42 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:23:42 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:23:42 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:23:42 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:23:42 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:23:42 user devstack@n-api.service[61423]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:23:42 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:23:42 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:23:42 user devstack@n-api.service[61423]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:23:42 user devstack@n-api.service[61423]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:23:42 user devstack@n-api.service[61423]: method: > Apr 11 17:23:42 user devstack@n-api.service[61423]: exception: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:23:42 user devstack@n-api.service[61423]: action_args: {'id': 'b5f9fe94-98f0-4094-8003-53c06cbfd5cb'} Apr 11 17:23:42 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:23:42 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:23:42 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:23:42 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-54db2211-11d8-4f5c-99b2-c68fc6a978be tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb" status: 404 len: 111 microversion: 2.1 time: 0.030342 Apr 11 17:23:42 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 315/948] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:23:42 2023] GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 17:23:42 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-097884d4-270e-4a19-b1e5-5cab136f1369 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '.version_select at 0x7f5bdd967d00>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:42 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-097884d4-270e-4a19-b1e5-5cab136f1369 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874843256" status: 202 len: 0 microversion: 2.1 time: 0.040092 Apr 11 17:23:42 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 316/949] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 17:23:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874843256 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:23:43 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ef56ad9c-1b45-43ab-bd48-f16fe2bde12d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: .version_select at 0x7f5bdc611bd0>, body: {"keypair": {"name": "tempest-keypair-1451399098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpPWrhpVFdGbf1Dj+4OJg1zutabQuVyX6CAht6XZMDzZuixaz5necKNKPkgnyoYmDHjNVCYHy6lFQCcf7nPglD1D/WKnwp9dX1ijXlmg5LXFi9MHgyyFhA9DYyjhknzpg=="}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:43 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-ef56ad9c-1b45-43ab-bd48-f16fe2bde12d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for project 23c663a759724bbda32f189ceedf6675. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:23:43 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-ef56ad9c-1b45-43ab-bd48-f16fe2bde12d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for user ff27d08254f74491aba3386c9b901300 and project 23c663a759724bbda32f189ceedf6675. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:23:43 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ef56ad9c-1b45-43ab-bd48-f16fe2bde12d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055846 Apr 11 17:23:43 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 319/950] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:23:43 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:44 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d496845-40fd-4062-91e7-693c7db8a4f3", "name": "network-vif-plugged", "status": "completed", "tag": "4cd65e38-8f39-42d1-b015-f1a6679549b7"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:44 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:44 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] Creating event network-vif-plugged:4cd65e38-8f39-42d1-b015-f1a6679549b7 for instance 8d496845-40fd-4062-91e7-693c7db8a4f3 on user Apr 11 17:23:44 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-7d420531-2004-40fc-a8d8-adad59bbe1e9 req-184c660c-9342-46e1-86af-9275e57884cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032406 Apr 11 17:23:44 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 316/951] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:44 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1945321253", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2"}], "security_groups": [{"name": "tempest-securitygroup--1533876751"}], "key_name": "tempest-keypair-1451399098", "user_data": "}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] validate_networks() for [('f6d30218-0af4-4ce4-bb7e-990a43a37ec2', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for project 23c663a759724bbda32f189ceedf6675. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for user ff27d08254f74491aba3386c9b901300 and project 23c663a759724bbda32f189ceedf6675. Resources: {'cores', 'instances', 'ram'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:23:45 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:23:45 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-6cbd0eb2-11c1-43d2-9e60-2fb25d3c733d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.667114 Apr 11 17:23:45 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 317/952] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:23:44 2023] POST /compute/v2.1/servers => generated 400 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:23:45 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3e3ee2ab-e288-4cf6-a13f-d92c9344c6f7 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:45 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-3e3ee2ab-e288-4cf6-a13f-d92c9344c6f7 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:45 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-3e3ee2ab-e288-4cf6-a13f-d92c9344c6f7 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:23:45 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-3e3ee2ab-e288-4cf6-a13f-d92c9344c6f7 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0" status: 200 len: 1236 microversion: 2.1 time: 0.163611 Apr 11 17:23:45 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 320/953] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:23:45 2023] GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0 => generated 1236 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:23:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-82c85eb3-9725-4278-9c03-9d375dfd347c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:47 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-82c85eb3-9725-4278-9c03-9d375dfd347c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82c85eb3-9725-4278-9c03-9d375dfd347c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82c85eb3-9725-4278-9c03-9d375dfd347c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82c85eb3-9725-4278-9c03-9d375dfd347c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82c85eb3-9725-4278-9c03-9d375dfd347c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82c85eb3-9725-4278-9c03-9d375dfd347c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82c85eb3-9725-4278-9c03-9d375dfd347c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:47 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-82c85eb3-9725-4278-9c03-9d375dfd347c tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.095805 Apr 11 17:23:47 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 317/954] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 17:23:47 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/os-interface => generated 282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 17:23:48 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9f0853-b703-414b-ba98-72215c25f3c0", "tag": "50e996b3-f103-493c-8b71-348061a520b0"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:48 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:48 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=17 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] Creating event network-changed:50e996b3-f103-493c-8b71-348061a520b0 for instance 3b9f0853-b703-414b-ba98-72215c25f3c0 on user Apr 11 17:23:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-b255cc6e-426c-4628-b7d3-b7af3fb26c31 req-c0131368-3da1-4fcb-8119-9e19fe14d319 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051586 Apr 11 17:23:48 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 318/955] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:48 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:48 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:48 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] Creating event network-changed:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:23:48 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-82ccc575-cd7c-4c2d-bf64-cb43d0c2306b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:48 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-82ccc575-cd7c-4c2d-bf64-cb43d0c2306b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:48 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-c9012ad6-00f0-472b-87db-ada972d4f5da req-c850eff8-8f52-47a2-b098-2190b6d0c311 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072016 Apr 11 17:23:48 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 321/956] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82ccc575-cd7c-4c2d-bf64-cb43d0c2306b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82ccc575-cd7c-4c2d-bf64-cb43d0c2306b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82ccc575-cd7c-4c2d-bf64-cb43d0c2306b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82ccc575-cd7c-4c2d-bf64-cb43d0c2306b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82ccc575-cd7c-4c2d-bf64-cb43d0c2306b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:48 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-82ccc575-cd7c-4c2d-bf64-cb43d0c2306b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:48 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-82ccc575-cd7c-4c2d-bf64-cb43d0c2306b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/ips" status: 200 len: 110 microversion: 2.20 time: 0.045215 Apr 11 17:23:48 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 318/957] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 17:23:48 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/ips => generated 110 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:23:50 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:50 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:50 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lazy-loading 'flavor' on Instance uuid e5c59a1a-121c-41c4-8ca4-b6675b5191c8 {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:23:51 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f0853-b703-414b-ba98-72215c25f3c0", "name": "network-vif-plugged", "status": "completed", "tag": "50e996b3-f103-493c-8b71-348061a520b0"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:51 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] Creating event network-vif-plugged:50e996b3-f103-493c-8b71-348061a520b0 for instance 3b9f0853-b703-414b-ba98-72215c25f3c0 on user Apr 11 17:23:51 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-8ca733db-35de-4795-ab50-b68b3d558fe5 req-bcc888c5-fa2e-45ab-bbbe-35f6a6affaa0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223020 Apr 11 17:23:51 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 322/958] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:51 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9f6c21df-ec08-4f89-a12a-4646838cbee5 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/action" status: 202 len: 0 microversion: 2.20 time: 1.050038 Apr 11 17:23:51 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 319/959] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 17:23:50 2023] POST /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/action => generated 0 bytes in 1053 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:23:51 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "name": "network-vif-unplugged", "status": "completed", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:23:51 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:23:51 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=13 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:51 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-17bd8f52-ed91-4beb-bd27-babb960c8380 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8" status: 200 len: 1711 microversion: 2.20 time: 0.307972 Apr 11 17:23:51 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 319/960] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:23:51 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => generated 1711 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:23:51 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] Creating event network-vif-unplugged:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:23:51 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-50f6d9cf-8820-46c0-ba2f-1ca40ffa25a9 req-d87998bb-053a-4a7b-a7ad-255e0078c7a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037814 Apr 11 17:23:51 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 323/961] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:53 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f0853-b703-414b-ba98-72215c25f3c0", "name": "network-vif-plugged", "status": "completed", "tag": "50e996b3-f103-493c-8b71-348061a520b0"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:53 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] Creating event network-vif-plugged:50e996b3-f103-493c-8b71-348061a520b0 for instance 3b9f0853-b703-414b-ba98-72215c25f3c0 on user Apr 11 17:23:53 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-13fa6703-03c4-4cee-b969-0fcfded12562 req-c132a825-5bac-45fb-9eac-d2f1192c9dbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052760 Apr 11 17:23:53 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 320/962] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:53 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "name": "network-vif-plugged", "status": "completed", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:53 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] Creating event network-vif-plugged:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:23:53 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-4c47ba68-d218-468c-8095-8bf67494947f req-8e8c7b78-84ca-42fb-b54f-8a110dd7632b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032838 Apr 11 17:23:53 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 320/963] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:56 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=8 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:56 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:23:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:56 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:56 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] Creating event network-changed:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:23:56 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-22df94ba-9a5a-45e5-9609-dbf63f65f479 req-211e5ac8-e036-4883-8f36-1c41a84b8350 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108428 Apr 11 17:23:56 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 324/964] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:23:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:23:58 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:58 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=12 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:23:58 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6c1e6d50-579a-406f-a731-3302dec39749 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:23:58 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-6c1e6d50-579a-406f-a731-3302dec39749 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:23:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d50-579a-406f-a731-3302dec39749 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d50-579a-406f-a731-3302dec39749 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d50-579a-406f-a731-3302dec39749 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d50-579a-406f-a731-3302dec39749 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:23:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d50-579a-406f-a731-3302dec39749 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:23:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6c1e6d50-579a-406f-a731-3302dec39749 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:23:58 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-6c1e6d50-579a-406f-a731-3302dec39749 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:23:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-6c1e6d50-579a-406f-a731-3302dec39749 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 200 len: 1546 microversion: 2.1 time: 0.180812 Apr 11 17:23:58 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 321/965] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:23:58 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 1546 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:24:11 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:11 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=26 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:11 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-b761d093-3ee1-48f8-9b90-aa0320fd5bd1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:24:11 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-b761d093-3ee1-48f8-9b90-aa0320fd5bd1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:24:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b761d093-3ee1-48f8-9b90-aa0320fd5bd1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b761d093-3ee1-48f8-9b90-aa0320fd5bd1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b761d093-3ee1-48f8-9b90-aa0320fd5bd1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b761d093-3ee1-48f8-9b90-aa0320fd5bd1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b761d093-3ee1-48f8-9b90-aa0320fd5bd1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-b761d093-3ee1-48f8-9b90-aa0320fd5bd1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:11 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-b761d093-3ee1-48f8-9b90-aa0320fd5bd1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:24:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-b761d093-3ee1-48f8-9b90-aa0320fd5bd1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53" status: 200 len: 1538 microversion: 2.1 time: 0.435304 Apr 11 17:24:11 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 321/966] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:24:11 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 => generated 1538 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:24:16 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:16 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-8b8f8f92-0eba-469b-82a3-650065259608 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:24:16 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-8b8f8f92-0eba-469b-82a3-650065259608 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:24:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8b8f8f92-0eba-469b-82a3-650065259608 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8b8f8f92-0eba-469b-82a3-650065259608 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8b8f8f92-0eba-469b-82a3-650065259608 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8b8f8f92-0eba-469b-82a3-650065259608 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8b8f8f92-0eba-469b-82a3-650065259608 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-8b8f8f92-0eba-469b-82a3-650065259608 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:16 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-8b8f8f92-0eba-469b-82a3-650065259608 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:24:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-8b8f8f92-0eba-469b-82a3-650065259608 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210" status: 200 len: 1440 microversion: 2.1 time: 0.178357 Apr 11 17:24:16 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 325/967] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:24:16 2023] GET /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210 => generated 1440 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:24:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a3279a59-ea28-4eba-8a6c-a9ac0e30d337 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:24:27 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a3279a59-ea28-4eba-8a6c-a9ac0e30d337 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:24:27 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=7 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:27 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a3279a59-ea28-4eba-8a6c-a9ac0e30d337 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a3279a59-ea28-4eba-8a6c-a9ac0e30d337 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a3279a59-ea28-4eba-8a6c-a9ac0e30d337 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a3279a59-ea28-4eba-8a6c-a9ac0e30d337 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a3279a59-ea28-4eba-8a6c-a9ac0e30d337 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a3279a59-ea28-4eba-8a6c-a9ac0e30d337 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:27 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-a3279a59-ea28-4eba-8a6c-a9ac0e30d337 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeef943ec0a0456da8e9b742385ac7f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4d0572552242c69df31613597ed588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:24:27 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-a3279a59-ea28-4eba-8a6c-a9ac0e30d337 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d496845-40fd-4062-91e7-693c7db8a4f3" status: 200 len: 1486 microversion: 2.1 time: 0.153701 Apr 11 17:24:27 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 322/968] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:24:27 2023] GET /compute/v2.1/servers/8d496845-40fd-4062-91e7-693c7db8a4f3 => generated 1486 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:24:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-0a456043-bde8-45db-9120-15f4461a5634 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:24:35 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-0a456043-bde8-45db-9120-15f4461a5634 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:24:35 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:35 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a456043-bde8-45db-9120-15f4461a5634 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a456043-bde8-45db-9120-15f4461a5634 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a456043-bde8-45db-9120-15f4461a5634 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a456043-bde8-45db-9120-15f4461a5634 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a456043-bde8-45db-9120-15f4461a5634 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0a456043-bde8-45db-9120-15f4461a5634 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:36 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-0a456043-bde8-45db-9120-15f4461a5634 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:24:36 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-0a456043-bde8-45db-9120-15f4461a5634 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0" status: 200 len: 1547 microversion: 2.1 time: 0.147272 Apr 11 17:24:36 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 322/969] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:24:35 2023] GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0 => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:24:41 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:24:41 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-fd0e8d50-3c1f-4057-9061-2f72e859b1ef tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8" status: 200 len: 1652 microversion: 2.20 time: 0.148916 Apr 11 17:24:41 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 326/970] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:24:41 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => generated 1652 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:24:58 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:58 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:58 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a87b427e-b2cf-4013-96c4-4a93d9bec13c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:24:58 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a87b427e-b2cf-4013-96c4-4a93d9bec13c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:24:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a87b427e-b2cf-4013-96c4-4a93d9bec13c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a87b427e-b2cf-4013-96c4-4a93d9bec13c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a87b427e-b2cf-4013-96c4-4a93d9bec13c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a87b427e-b2cf-4013-96c4-4a93d9bec13c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a87b427e-b2cf-4013-96c4-4a93d9bec13c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a87b427e-b2cf-4013-96c4-4a93d9bec13c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:59 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-a87b427e-b2cf-4013-96c4-4a93d9bec13c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:24:59 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-a87b427e-b2cf-4013-96c4-4a93d9bec13c tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 200 len: 1546 microversion: 2.1 time: 0.395124 Apr 11 17:24:59 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 323/971] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:24:58 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 1546 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:24:59 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-70552d9e-fcc8-49c3-9528-d48669c8884e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:24:59 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-70552d9e-fcc8-49c3-9528-d48669c8884e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:24:59 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:59 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-70552d9e-fcc8-49c3-9528-d48669c8884e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-70552d9e-fcc8-49c3-9528-d48669c8884e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-70552d9e-fcc8-49c3-9528-d48669c8884e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-70552d9e-fcc8-49c3-9528-d48669c8884e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-70552d9e-fcc8-49c3-9528-d48669c8884e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:59 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-70552d9e-fcc8-49c3-9528-d48669c8884e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:59 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-70552d9e-fcc8-49c3-9528-d48669c8884e tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "POST /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d/action" status: 200 len: 28416 microversion: 2.1 time: 0.224216 Apr 11 17:24:59 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 323/972] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:24:59 2023] POST /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d/action => generated 28416 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:24:59 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-0d24e0e3-c52c-4cc3-be14-1e96a56c54a9 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:24:59 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-0d24e0e3-c52c-4cc3-be14-1e96a56c54a9 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:24:59 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:59 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:24:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d24e0e3-c52c-4cc3-be14-1e96a56c54a9 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d24e0e3-c52c-4cc3-be14-1e96a56c54a9 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d24e0e3-c52c-4cc3-be14-1e96a56c54a9 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:24:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d24e0e3-c52c-4cc3-be14-1e96a56c54a9 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:24:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d24e0e3-c52c-4cc3-be14-1e96a56c54a9 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:24:59 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0d24e0e3-c52c-4cc3-be14-1e96a56c54a9 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:00 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-0d24e0e3-c52c-4cc3-be14-1e96a56c54a9 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:00 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-0d24e0e3-c52c-4cc3-be14-1e96a56c54a9 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1" status: 200 len: 1541 microversion: 2.1 time: 0.688142 Apr 11 17:25:00 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 327/973] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:24:59 2023] GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1 => generated 1541 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:25:11 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6171f5ed-b9f7-4a1f-89b7-3f8cd8e9a1f3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:11 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-6171f5ed-b9f7-4a1f-89b7-3f8cd8e9a1f3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:11 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:11 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6171f5ed-b9f7-4a1f-89b7-3f8cd8e9a1f3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6171f5ed-b9f7-4a1f-89b7-3f8cd8e9a1f3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6171f5ed-b9f7-4a1f-89b7-3f8cd8e9a1f3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6171f5ed-b9f7-4a1f-89b7-3f8cd8e9a1f3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6171f5ed-b9f7-4a1f-89b7-3f8cd8e9a1f3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6171f5ed-b9f7-4a1f-89b7-3f8cd8e9a1f3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:11 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-6171f5ed-b9f7-4a1f-89b7-3f8cd8e9a1f3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-6171f5ed-b9f7-4a1f-89b7-3f8cd8e9a1f3 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53" status: 200 len: 1538 microversion: 2.1 time: 0.139004 Apr 11 17:25:11 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 324/974] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:25:11 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 => generated 1538 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2d773495-8b7f-4430-b0c2-5026a7c13ecc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-2d773495-8b7f-4430-b0c2-5026a7c13ecc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2d773495-8b7f-4430-b0c2-5026a7c13ecc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Searching by: {'deleted': False, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91'} {{(pid=61423) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d773495-8b7f-4430-b0c2-5026a7c13ecc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d773495-8b7f-4430-b0c2-5026a7c13ecc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d773495-8b7f-4430-b0c2-5026a7c13ecc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d773495-8b7f-4430-b0c2-5026a7c13ecc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d773495-8b7f-4430-b0c2-5026a7c13ecc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d773495-8b7f-4430-b0c2-5026a7c13ecc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:11 user devstack@n-api.service[61423]: DEBUG nova.compute.multi_cell_list [None req-2d773495-8b7f-4430-b0c2-5026a7c13ecc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61423) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 17:25:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2d773495-8b7f-4430-b0c2-5026a7c13ecc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.072943 Apr 11 17:25:11 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 324/975] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 17:25:11 2023] GET /compute/v2.1/servers => generated 341 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:11 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:11 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:11 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3b10fb66-802a-4658-89c4-2d5f3123d7a1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:11 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-3b10fb66-802a-4658-89c4-2d5f3123d7a1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3b10fb66-802a-4658-89c4-2d5f3123d7a1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3b10fb66-802a-4658-89c4-2d5f3123d7a1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3b10fb66-802a-4658-89c4-2d5f3123d7a1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3b10fb66-802a-4658-89c4-2d5f3123d7a1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3b10fb66-802a-4658-89c4-2d5f3123d7a1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:11 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3b10fb66-802a-4658-89c4-2d5f3123d7a1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:12 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-3b10fb66-802a-4658-89c4-2d5f3123d7a1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-3b10fb66-802a-4658-89c4-2d5f3123d7a1 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53" status: 200 len: 1538 microversion: 2.1 time: 0.152309 Apr 11 17:25:12 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 328/976] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:25:11 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 => generated 1538 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:25:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2785e1a-385f-4f66-b8fa-db0f5963af98"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:13 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-f8d60509-c24b-45bd-ae2c-0d2b6e85c316 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269547 Apr 11 17:25:13 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 325/977] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:25:13 2023] POST /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:16 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-da6a829f-6c1d-4b6b-91b1-e03052bc3bc7 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:16 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-da6a829f-6c1d-4b6b-91b1-e03052bc3bc7 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da6a829f-6c1d-4b6b-91b1-e03052bc3bc7 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da6a829f-6c1d-4b6b-91b1-e03052bc3bc7 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da6a829f-6c1d-4b6b-91b1-e03052bc3bc7 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da6a829f-6c1d-4b6b-91b1-e03052bc3bc7 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da6a829f-6c1d-4b6b-91b1-e03052bc3bc7 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-da6a829f-6c1d-4b6b-91b1-e03052bc3bc7 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:16 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-da6a829f-6c1d-4b6b-91b1-e03052bc3bc7 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:16 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-da6a829f-6c1d-4b6b-91b1-e03052bc3bc7 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210" status: 200 len: 1440 microversion: 2.1 time: 0.166174 Apr 11 17:25:16 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 325/978] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:25:16 2023] GET /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210 => generated 1440 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:25:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f054c2a-84ad-48a6-ad76-8aaf5038c210", "tag": "56ae4ea0-6935-4111-9767-36f6e5d04d93"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] Creating event network-changed:56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 on user Apr 11 17:25:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-0764fdbb-e41f-4860-9932-57defd392b65 req-2d9cebac-d799-4adc-99d8-5ce346520d82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153826 Apr 11 17:25:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 329/979] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:20 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-21a949af-eda9-4e37-85b0-c825aadfe9c0 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:20 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-21a949af-eda9-4e37-85b0-c825aadfe9c0 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-21a949af-eda9-4e37-85b0-c825aadfe9c0 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-21a949af-eda9-4e37-85b0-c825aadfe9c0 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-21a949af-eda9-4e37-85b0-c825aadfe9c0 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-21a949af-eda9-4e37-85b0-c825aadfe9c0 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-21a949af-eda9-4e37-85b0-c825aadfe9c0 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-21a949af-eda9-4e37-85b0-c825aadfe9c0 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:20 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-21a949af-eda9-4e37-85b0-c825aadfe9c0 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-21a949af-eda9-4e37-85b0-c825aadfe9c0 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53" status: 200 len: 1584 microversion: 2.1 time: 0.178327 Apr 11 17:25:20 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 326/980] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:25:20 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 => generated 1584 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:25:21 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-17465943", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-967443343", "security_groups": [{"name": "tempest-secgroup-smoke-1559236648"}], "block_device_mapping_v2": [{"uuid": "e180dcbd-cdfe-497e-86e0-e06c5b4c32da", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd04c0b8-1ba3-450d-9eab-fd88096ba41e"}]}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:21 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] validate_networks() for [('dd04c0b8-1ba3-450d-9eab-fd88096ba41e', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:25:21 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Getting quotas for user c7dcfe84c23f4c0aa80b8f287f0ab004 and project 631ee1e131e94577b853a5ae0886a318. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:25:22 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] Creating event network-changed:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:25:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-ac1f25a5-4ea6-4a67-b9bc-2deb0001494e req-56d7987b-5d15-4a31-8996-1f1f3f9ef608 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043009 Apr 11 17:25:22 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 330/981] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:25:22 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e180dcbd-cdfe-497e-86e0-e06c5b4c32da',volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:25:23 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-65c4f608-949a-46f0-8db1-fa053ef626f1 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.729450 Apr 11 17:25:23 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 326/982] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:25:21 2023] POST /compute/v2.1/servers => generated 404 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:25:23 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8fb5525f-6b5f-47a3-b425-1c0d10694aa5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:23 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8fb5525f-6b5f-47a3-b425-1c0d10694aa5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:23 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-8fb5525f-6b5f-47a3-b425-1c0d10694aa5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:23 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8fb5525f-6b5f-47a3-b425-1c0d10694aa5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96" status: 200 len: 1087 microversion: 2.1 time: 0.098966 Apr 11 17:25:23 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 327/983] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:25:23 2023] GET /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96 => generated 1087 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:25:24 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-af0f7e69-e760-4a33-b6dd-b4cf139cc819 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1809168048"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:24 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-af0f7e69-e760-4a33-b6dd-b4cf139cc819 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af0f7e69-e760-4a33-b6dd-b4cf139cc819 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af0f7e69-e760-4a33-b6dd-b4cf139cc819 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af0f7e69-e760-4a33-b6dd-b4cf139cc819 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af0f7e69-e760-4a33-b6dd-b4cf139cc819 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af0f7e69-e760-4a33-b6dd-b4cf139cc819 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:24 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-af0f7e69-e760-4a33-b6dd-b4cf139cc819 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:24 user devstack@n-api.service[61424]: INFO nova.network.security_group_api [None req-af0f7e69-e760-4a33-b6dd-b4cf139cc819 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Adding security group 430bbc5a-523b-41c2-8138-cf4beb2b791c to port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 Apr 11 17:25:25 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-af0f7e69-e760-4a33-b6dd-b4cf139cc819 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/action" status: 202 len: 0 microversion: 2.1 time: 0.634153 Apr 11 17:25:25 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 331/984] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:25:24 2023] POST /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d10e6dba-8726-418d-a83d-5d10c2a83c08 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:25 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d10e6dba-8726-418d-a83d-5d10c2a83c08 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d10e6dba-8726-418d-a83d-5d10c2a83c08 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d10e6dba-8726-418d-a83d-5d10c2a83c08 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d10e6dba-8726-418d-a83d-5d10c2a83c08 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d10e6dba-8726-418d-a83d-5d10c2a83c08 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d10e6dba-8726-418d-a83d-5d10c2a83c08 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d10e6dba-8726-418d-a83d-5d10c2a83c08 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:25 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] Creating event network-changed:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:25:25 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-7b6361a9-e4c6-411c-8879-5e09990f682e req-2fe40903-c089-48f7-b3a9-dde1533751b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035048 Apr 11 17:25:25 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 327/985] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:25:25 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-d10e6dba-8726-418d-a83d-5d10c2a83c08 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d10e6dba-8726-418d-a83d-5d10c2a83c08 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53" status: 200 len: 1749 microversion: 2.1 time: 0.324217 Apr 11 17:25:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 328/986] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:25:25 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 => generated 1749 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:25:25 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:25 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:25 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-9aa151df-f4c1-4f54-b013-d2e5b46a3224 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/action" status: 202 len: 0 microversion: 2.1 time: 0.108141 Apr 11 17:25:25 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 332/987] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:25:25 2023] POST /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-de3ae595-e960-4ea2-9b85-c84a9c0d51cc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-de3ae595-e960-4ea2-9b85-c84a9c0d51cc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de3ae595-e960-4ea2-9b85-c84a9c0d51cc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de3ae595-e960-4ea2-9b85-c84a9c0d51cc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de3ae595-e960-4ea2-9b85-c84a9c0d51cc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de3ae595-e960-4ea2-9b85-c84a9c0d51cc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de3ae595-e960-4ea2-9b85-c84a9c0d51cc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de3ae595-e960-4ea2-9b85-c84a9c0d51cc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:25 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-de3ae595-e960-4ea2-9b85-c84a9c0d51cc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:25 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-de3ae595-e960-4ea2-9b85-c84a9c0d51cc tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53" status: 200 len: 1741 microversion: 2.1 time: 0.171704 Apr 11 17:25:25 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 328/988] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:25:25 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:25:26 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d4f216a-af3c-485b-898a-64a2302b8a96", "tag": "ad0ff01a-d361-4eb0-af56-2afe1460be14"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] Creating event network-changed:ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance 9d4f216a-af3c-485b-898a-64a2302b8a96 on user Apr 11 17:25:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-6e30d589-57f4-4a83-bcbf-f853fd6db554 req-f807d96e-f5fd-4b40-a3cd-ceb84f9c253a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036368 Apr 11 17:25:26 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 329/989] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:25:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-e2c77a83-7dd6-48ee-9e3c-268c6e6f0540 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8d496845-40fd-4062-91e7-693c7db8a4f3" status: 204 len: 0 microversion: 2.1 time: 0.126806 Apr 11 17:25:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 333/990] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:25:28 2023] DELETE /compute/v2.1/servers/8d496845-40fd-4062-91e7-693c7db8a4f3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:25:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ab8001e0-e7bc-4842-8695-d6d428b4c5af tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:28 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ab8001e0-e7bc-4842-8695-d6d428b4c5af tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ab8001e0-e7bc-4842-8695-d6d428b4c5af tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ab8001e0-e7bc-4842-8695-d6d428b4c5af tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ab8001e0-e7bc-4842-8695-d6d428b4c5af tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ab8001e0-e7bc-4842-8695-d6d428b4c5af tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ab8001e0-e7bc-4842-8695-d6d428b4c5af tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ab8001e0-e7bc-4842-8695-d6d428b4c5af tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:28 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-ab8001e0-e7bc-4842-8695-d6d428b4c5af tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeef943ec0a0456da8e9b742385ac7f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4d0572552242c69df31613597ed588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ab8001e0-e7bc-4842-8695-d6d428b4c5af tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d496845-40fd-4062-91e7-693c7db8a4f3" status: 200 len: 1492 microversion: 2.1 time: 0.231866 Apr 11 17:25:28 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 329/991] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:25:28 2023] GET /compute/v2.1/servers/8d496845-40fd-4062-91e7-693c7db8a4f3 => generated 1492 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:25:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d496845-40fd-4062-91e7-693c7db8a4f3", "name": "network-vif-unplugged", "status": "completed", "tag": "4cd65e38-8f39-42d1-b015-f1a6679549b7"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] Creating event network-vif-unplugged:4cd65e38-8f39-42d1-b015-f1a6679549b7 for instance 8d496845-40fd-4062-91e7-693c7db8a4f3 on user Apr 11 17:25:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-0e1968ca-0215-4a5f-ab13-b7ef735ea97e req-8b2803cf-37a7-47a1-946f-b8da8c7ab5f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036079 Apr 11 17:25:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 330/992] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "name": "network-vif-unplugged", "status": "completed", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] Creating event network-vif-unplugged:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:25:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-426ea01a-ca94-4f40-ba4d-085ba8e1191b req-c2a52cd9-0719-4645-92ef-881b82002586 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055192 Apr 11 17:25:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 334/993] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d496845-40fd-4062-91e7-693c7db8a4f3", "name": "network-vif-plugged", "status": "completed", "tag": "4cd65e38-8f39-42d1-b015-f1a6679549b7"}, {"server_uuid": "8d496845-40fd-4062-91e7-693c7db8a4f3", "name": "network-vif-deleted", "tag": "4cd65e38-8f39-42d1-b015-f1a6679549b7"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] Creating event network-vif-plugged:4cd65e38-8f39-42d1-b015-f1a6679549b7 for instance 8d496845-40fd-4062-91e7-693c7db8a4f3 on user Apr 11 17:25:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] Creating event network-vif-deleted:4cd65e38-8f39-42d1-b015-f1a6679549b7 for instance 8d496845-40fd-4062-91e7-693c7db8a4f3 on user Apr 11 17:25:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-d8af97b4-ca6c-4791-8634-2c20b7006727 req-f7eef711-107c-4e34-bff9-5860c9500971 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041020 Apr 11 17:25:30 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 330/994] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:30 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "name": "network-vif-plugged", "status": "completed", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] Creating event network-vif-plugged:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:25:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-6a6e5281-6f65-4b85-bb79-8b2a26433535 req-ea08a3c7-4952-4b5e-985f-a126819f5280 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030710 Apr 11 17:25:30 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 331/995] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:32 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4f216a-af3c-485b-898a-64a2302b8a96", "name": "network-vif-plugged", "status": "completed", "tag": "ad0ff01a-d361-4eb0-af56-2afe1460be14"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:32 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] Creating event network-vif-plugged:ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance 9d4f216a-af3c-485b-898a-64a2302b8a96 on user Apr 11 17:25:32 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-49343ad8-ee59-4fb7-9c60-f462567e526f req-8b696964-65c3-4859-affb-f21463ca319e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037199 Apr 11 17:25:32 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 335/996] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:33 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:33 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:33 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "name": "network-vif-plugged", "status": "completed", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}, {"server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "name": "network-vif-plugged", "status": "completed", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:33 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Creating event network-vif-plugged:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:25:33 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] Creating event network-vif-plugged:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:25:33 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-e09bce9e-de3e-44ef-b7ea-0c459e76aed7 req-1703b932-ffcc-4f41-a7e6-bce8bab290f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033851 Apr 11 17:25:33 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 331/997] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:34 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:34 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4f216a-af3c-485b-898a-64a2302b8a96", "name": "network-vif-plugged", "status": "completed", "tag": "ad0ff01a-d361-4eb0-af56-2afe1460be14"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] Creating event network-vif-plugged:ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance 9d4f216a-af3c-485b-898a-64a2302b8a96 on user Apr 11 17:25:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-df389d1f-7001-43aa-95a9-7fa73b64c22f req-409909b3-154c-4561-b3d1-30b4c9ea8fd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032571 Apr 11 17:25:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 332/998] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:36 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-a0c119d6-e9c2-416d-865f-57549eb0c7d8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:36 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-a0c119d6-e9c2-416d-865f-57549eb0c7d8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a0c119d6-e9c2-416d-865f-57549eb0c7d8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a0c119d6-e9c2-416d-865f-57549eb0c7d8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a0c119d6-e9c2-416d-865f-57549eb0c7d8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a0c119d6-e9c2-416d-865f-57549eb0c7d8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a0c119d6-e9c2-416d-865f-57549eb0c7d8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-a0c119d6-e9c2-416d-865f-57549eb0c7d8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:36 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-a0c119d6-e9c2-416d-865f-57549eb0c7d8 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.106139 Apr 11 17:25:36 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 336/999] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:25:36 2023] GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-interface => generated 283 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9f0853-b703-414b-ba98-72215c25f3c0", "tag": "50e996b3-f103-493c-8b71-348061a520b0"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] Creating event network-changed:50e996b3-f103-493c-8b71-348061a520b0 for instance 3b9f0853-b703-414b-ba98-72215c25f3c0 on user Apr 11 17:25:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-f7da7e9e-45d7-4ffe-91ea-4486b7b33712 req-0ef37400-3598-4bed-8d98-e878435c356e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041335 Apr 11 17:25:37 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 332/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c6786188-6673-4561-93c5-25ace0348229 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:37 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c6786188-6673-4561-93c5-25ace0348229 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c6786188-6673-4561-93c5-25ace0348229 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c6786188-6673-4561-93c5-25ace0348229 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c6786188-6673-4561-93c5-25ace0348229 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c6786188-6673-4561-93c5-25ace0348229 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c6786188-6673-4561-93c5-25ace0348229 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c6786188-6673-4561-93c5-25ace0348229 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c6786188-6673-4561-93c5-25ace0348229 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/ips" status: 200 len: 109 microversion: 2.1 time: 0.038647 Apr 11 17:25:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 333/1001] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 17:25:37 2023] GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/ips => generated 109 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:38 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d88a41a-dae7-4a3d-adea-c9187ab4dd5c"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:38 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:38 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-0e0ad8bf-2a84-4290-8f05-9ff759193823 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336038 Apr 11 17:25:39 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 337/1002] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:25:38 2023] POST /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:42 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2c854f51-a873-4613-b9a0-abe26cfdab00 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "644a078e-fe3a-4d72-9f9e-4f92247e7101"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:42 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2c854f51-a873-4613-b9a0-abe26cfdab00 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:42 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c854f51-a873-4613-b9a0-abe26cfdab00 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c854f51-a873-4613-b9a0-abe26cfdab00 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c854f51-a873-4613-b9a0-abe26cfdab00 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c854f51-a873-4613-b9a0-abe26cfdab00 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c854f51-a873-4613-b9a0-abe26cfdab00 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:42 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2c854f51-a873-4613-b9a0-abe26cfdab00 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:42 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=37 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:42 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2c854f51-a873-4613-b9a0-abe26cfdab00 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.544280 Apr 11 17:25:42 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 333/1003] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 17:25:41 2023] POST /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/os-volume_attachments => generated 188 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 17:25:42 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d8aebbfa-dc08-435c-8528-7b1cfef0e94a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:42 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d8aebbfa-dc08-435c-8528-7b1cfef0e94a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:42 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=23 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d8aebbfa-dc08-435c-8528-7b1cfef0e94a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d8aebbfa-dc08-435c-8528-7b1cfef0e94a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d8aebbfa-dc08-435c-8528-7b1cfef0e94a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d8aebbfa-dc08-435c-8528-7b1cfef0e94a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d8aebbfa-dc08-435c-8528-7b1cfef0e94a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d8aebbfa-dc08-435c-8528-7b1cfef0e94a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:42 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:42 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d8aebbfa-dc08-435c-8528-7b1cfef0e94a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/os-volume_attachments/644a078e-fe3a-4d72-9f9e-4f92247e7101" status: 202 len: 0 microversion: 2.20 time: 0.248082 Apr 11 17:25:42 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 334/1004] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 17:25:42 2023] DELETE /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/os-volume_attachments/644a078e-fe3a-4d72-9f9e-4f92247e7101 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:25:42 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:42 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:42 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:42 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:25:43 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61424) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 17:25:43 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-2aa97146-8a38-4aae-9ac5-ba53ceab5f43 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/action" status: 202 len: 0 microversion: 2.20 time: 0.233177 Apr 11 17:25:43 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 338/1005] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 17:25:42 2023] POST /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:25:43 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:43 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:43 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:43 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:43 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:25:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-9b6f3e3e-65df-465d-b819-1b2a860bf39a tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8" status: 200 len: 1660 microversion: 2.20 time: 0.205584 Apr 11 17:25:43 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 334/1006] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:25:43 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => generated 1660 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:25:45 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:45 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] Creating event network-changed:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:25:45 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-fdeb43e6-2c58-4a75-98d2-0b14e85a67b7 req-75178449-de69-406c-b103-6c8c8cc259ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029965 Apr 11 17:25:45 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 335/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d88a41a-dae7-4a3d-adea-c9187ab4dd5c"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:47 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:47 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:47 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Invalid volume: volume 3d88a41a-dae7-4a3d-adea-c9187ab4dd5c is already attached to instances: 3b9f0853-b703-414b-ba98-72215c25f3c0 Apr 11 17:25:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:25:47 user devstack@n-api.service[61424]: request: POST /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-volume_attachments HTTP/1.1 Apr 11 17:25:47 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:25:47 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:25:47 user devstack@n-api.service[61424]: Connection: close Apr 11 17:25:47 user devstack@n-api.service[61424]: Content-Length: 74 Apr 11 17:25:47 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:25:47 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:25:47 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:25:47 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:25:47 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:25:47 user devstack@n-api.service[61424]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:25:47 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:25:47 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:25:47 user devstack@n-api.service[61424]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:25:47 user devstack@n-api.service[61424]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:25:47 user devstack@n-api.service[61424]: Apr 11 17:25:47 user devstack@n-api.service[61424]: {"volumeAttachment": {"volumeId": "3d88a41a-dae7-4a3d-adea-c9187ab4dd5c"}} Apr 11 17:25:47 user devstack@n-api.service[61424]: method: > Apr 11 17:25:47 user devstack@n-api.service[61424]: exception: Invalid volume: volume 3d88a41a-dae7-4a3d-adea-c9187ab4dd5c is already attached to instances: 3b9f0853-b703-414b-ba98-72215c25f3c0 Apr 11 17:25:47 user devstack@n-api.service[61424]: action_args: {'server_id': '3b9f0853-b703-414b-ba98-72215c25f3c0', 'body': {'volumeAttachment': {'volumeId': '3d88a41a-dae7-4a3d-adea-c9187ab4dd5c'}}} Apr 11 17:25:47 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3d88a41a-dae7-4a3d-adea-c9187ab4dd5c is already attached to instances: 3b9f0853-b703-414b-ba98-72215c25f3c0 Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3d88a41a-dae7-4a3d-adea-c9187ab4dd5c is already attached to instances: 3b9f0853-b703-414b-ba98-72215c25f3c0 Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3d88a41a-dae7-4a3d-adea-c9187ab4dd5c is already attached to instances: 3b9f0853-b703-414b-ba98-72215c25f3c0 Apr 11 17:25:47 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:25:47 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 400 to user: Invalid volume: volume 3d88a41a-dae7-4a3d-adea-c9187ab4dd5c is already attached to instances: 3b9f0853-b703-414b-ba98-72215c25f3c0 {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:25:47 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-315391f5-241d-494b-8541-bd85731b8626 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.409530 Apr 11 17:25:47 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 339/1008] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:25:47 2023] POST /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-volume_attachments => generated 174 bytes in 411 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:25:47 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:47 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:47 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:47 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'services' on Instance uuid 3b9f0853-b703-414b-ba98-72215c25f3c0 {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:25:47 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-78ac5885-022d-4d22-bed4-d97727ba3905 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-volume_attachments/3d88a41a-dae7-4a3d-adea-c9187ab4dd5c" status: 202 len: 0 microversion: 2.1 time: 0.172853 Apr 11 17:25:47 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 335/1009] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:25:47 2023] DELETE /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-volume_attachments/3d88a41a-dae7-4a3d-adea-c9187ab4dd5c => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:25:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-02134f53-9316-4ebe-a146-54abb4b384c1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:25:47 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-02134f53-9316-4ebe-a146-54abb4b384c1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:25:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-02134f53-9316-4ebe-a146-54abb4b384c1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-02134f53-9316-4ebe-a146-54abb4b384c1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-02134f53-9316-4ebe-a146-54abb4b384c1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-02134f53-9316-4ebe-a146-54abb4b384c1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-02134f53-9316-4ebe-a146-54abb4b384c1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-02134f53-9316-4ebe-a146-54abb4b384c1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-02134f53-9316-4ebe-a146-54abb4b384c1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045471 Apr 11 17:25:47 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 336/1010] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:25:47 2023] GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:52 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "name": "network-vif-plugged", "status": "completed", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:52 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:52 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] Creating event network-vif-plugged:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:25:52 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-c040dedb-e247-4c44-a6b5-de44240434a4 req-d2ddaf46-ae83-467b-875f-51eb618bd893 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033371 Apr 11 17:25:52 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 340/1011] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:25:54 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "name": "network-vif-plugged", "status": "completed", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:25:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:25:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:25:54 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:25:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] Creating event network-vif-plugged:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:25:54 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-a4abb55f-cccc-44c1-a76f-5a3e7f62c4ff req-566267c7-1402-491a-ab97-229c6cf2960f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030883 Apr 11 17:25:54 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 336/1012] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:25:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:26:00 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:00 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:00 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=5 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:00 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:00 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:00 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:26:00 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9b1a9a4e-430d-4f11-b5f8-fcb90134329b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 204 len: 0 microversion: 2.1 time: 0.132780 Apr 11 17:26:00 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 337/1013] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:26:00 2023] DELETE /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:26:00 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1e25994a-9b11-4f78-9ff5-952281711f68 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:00 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-1e25994a-9b11-4f78-9ff5-952281711f68 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e25994a-9b11-4f78-9ff5-952281711f68 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e25994a-9b11-4f78-9ff5-952281711f68 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e25994a-9b11-4f78-9ff5-952281711f68 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e25994a-9b11-4f78-9ff5-952281711f68 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e25994a-9b11-4f78-9ff5-952281711f68 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:00 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-1e25994a-9b11-4f78-9ff5-952281711f68 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:00 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-1e25994a-9b11-4f78-9ff5-952281711f68 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:26:00 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-1e25994a-9b11-4f78-9ff5-952281711f68 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 200 len: 1552 microversion: 2.1 time: 0.165791 Apr 11 17:26:00 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 341/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:26:00 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 1552 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:26:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40270cb6-8b7f-4658-8ea8-17a800d63f2d", "name": "network-vif-unplugged", "status": "completed", "tag": "09360ccd-e24b-449a-9e15-b86a5a12b501"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:26:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] Creating event network-vif-unplugged:09360ccd-e24b-449a-9e15-b86a5a12b501 for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d on user Apr 11 17:26:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-7d63d030-c4d8-4bb4-8940-e3dbcad5cfbf req-26e061a2-4d29-41ad-9492-8e9278faec3c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032629 Apr 11 17:26:00 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 337/1015] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:26:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:26:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-6a4a377c-89e2-46a8-90da-0bebc186b1e0 req-45b0d61f-44f5-4092-bd7c-1d0447f7c87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40270cb6-8b7f-4658-8ea8-17a800d63f2d", "name": "network-vif-deleted", "tag": "09360ccd-e24b-449a-9e15-b86a5a12b501"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:26:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6a4a377c-89e2-46a8-90da-0bebc186b1e0 req-45b0d61f-44f5-4092-bd7c-1d0447f7c87e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6a4a377c-89e2-46a8-90da-0bebc186b1e0 req-45b0d61f-44f5-4092-bd7c-1d0447f7c87e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6a4a377c-89e2-46a8-90da-0bebc186b1e0 req-45b0d61f-44f5-4092-bd7c-1d0447f7c87e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-6a4a377c-89e2-46a8-90da-0bebc186b1e0 req-45b0d61f-44f5-4092-bd7c-1d0447f7c87e service nova] Creating event network-vif-deleted:09360ccd-e24b-449a-9e15-b86a5a12b501 for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d on user Apr 11 17:26:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-6a4a377c-89e2-46a8-90da-0bebc186b1e0 req-45b0d61f-44f5-4092-bd7c-1d0447f7c87e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030288 Apr 11 17:26:02 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 338/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:26:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:26:02 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40270cb6-8b7f-4658-8ea8-17a800d63f2d", "name": "network-vif-plugged", "status": "completed", "tag": "09360ccd-e24b-449a-9e15-b86a5a12b501"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:26:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:02 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:02 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] Creating event network-vif-plugged:09360ccd-e24b-449a-9e15-b86a5a12b501 for instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d on user Apr 11 17:26:02 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-e6882115-fc7e-4d87-82f8-bf172be14a42 req-ab51b0e2-a1eb-44b8-8780-79f23d41d107 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034608 Apr 11 17:26:02 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 342/1017] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:26:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:26:13 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=9 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:13 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:13 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-28ce4490-2888-4c47-a511-0c62b9e598e8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:13 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-28ce4490-2888-4c47-a511-0c62b9e598e8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-28ce4490-2888-4c47-a511-0c62b9e598e8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-28ce4490-2888-4c47-a511-0c62b9e598e8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-28ce4490-2888-4c47-a511-0c62b9e598e8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-28ce4490-2888-4c47-a511-0c62b9e598e8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-28ce4490-2888-4c47-a511-0c62b9e598e8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-28ce4490-2888-4c47-a511-0c62b9e598e8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:13 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-28ce4490-2888-4c47-a511-0c62b9e598e8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:26:13 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-28ce4490-2888-4c47-a511-0c62b9e598e8 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96" status: 200 len: 1440 microversion: 2.1 time: 0.186832 Apr 11 17:26:13 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 338/1018] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:26:13 2023] GET /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96 => generated 1440 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 17:26:15 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:15 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:15 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f1caa612-da2e-4330-a2dc-b2dc71e1682f tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:15 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-f1caa612-da2e-4330-a2dc-b2dc71e1682f tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f1caa612-da2e-4330-a2dc-b2dc71e1682f tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f1caa612-da2e-4330-a2dc-b2dc71e1682f tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f1caa612-da2e-4330-a2dc-b2dc71e1682f tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f1caa612-da2e-4330-a2dc-b2dc71e1682f tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f1caa612-da2e-4330-a2dc-b2dc71e1682f tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f1caa612-da2e-4330-a2dc-b2dc71e1682f tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:15 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-f1caa612-da2e-4330-a2dc-b2dc71e1682f tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:26:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-f1caa612-da2e-4330-a2dc-b2dc71e1682f tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53" status: 200 len: 1749 microversion: 2.1 time: 0.163496 Apr 11 17:26:15 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 339/1019] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:26:15 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 => generated 1749 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] [instance: 8d496845-40fd-4062-91e7-693c7db8a4f3] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] HTTP exception thrown: Instance 8d496845-40fd-4062-91e7-693c7db8a4f3 could not be found. Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Request method failure captured: Apr 11 17:26:18 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/8d496845-40fd-4062-91e7-693c7db8a4f3 HTTP/1.1 Apr 11 17:26:18 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:26:18 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:26:18 user devstack@n-api.service[61424]: Connection: close Apr 11 17:26:18 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:26:18 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:26:18 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:26:18 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:26:18 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZb15Bt7WpHxxdXE3ugu8HlFn7CKrkEFjrh3z6UxPE89htARC3brLgobRezTGUpiyzbYCkqFsTHWE1aX8L_BhDyCIZ-bJh6JVbyXnAJ310ZzGdVV_VHH2HMoLzsack_eASiRzlK6w_6hIvMtNFxcUyusZN6xOrxCigELTN9UIOIxsrw Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Project-Id: fd4d0572552242c69df31613597ed588 Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Project-Name: tempest-VolumesActionsTest-815942062 Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd4d0572552242c69df31613597ed588"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fd4d0572552242c69df31613597ed588"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fd4d0572552242c69df31613597ed588"}]}] Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Tenant: tempest-VolumesActionsTest-815942062 Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Tenant-Id: fd4d0572552242c69df31613597ed588 Apr 11 17:26:18 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-VolumesActionsTest-815942062 Apr 11 17:26:18 user devstack@n-api.service[61424]: X-User: tempest-VolumesActionsTest-815942062-project-member Apr 11 17:26:18 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:26:18 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:26:18 user devstack@n-api.service[61424]: X-User-Id: aeef943ec0a0456da8e9b742385ac7f6 Apr 11 17:26:18 user devstack@n-api.service[61424]: X-User-Name: tempest-VolumesActionsTest-815942062-project-member Apr 11 17:26:18 user devstack@n-api.service[61424]: method: > Apr 11 17:26:18 user devstack@n-api.service[61424]: exception: Instance 8d496845-40fd-4062-91e7-693c7db8a4f3 could not be found. Apr 11 17:26:18 user devstack@n-api.service[61424]: action_args: {'id': '8d496845-40fd-4062-91e7-693c7db8a4f3'} Apr 11 17:26:18 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d496845-40fd-4062-91e7-693c7db8a4f3 could not be found. Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d496845-40fd-4062-91e7-693c7db8a4f3 could not be found. Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d496845-40fd-4062-91e7-693c7db8a4f3 could not be found. Apr 11 17:26:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:26:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] Returning 404 to user: Instance 8d496845-40fd-4062-91e7-693c7db8a4f3 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:26:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-bb7bcfa4-18f1-4ebe-a7e8-aabfdbbf24f4 tempest-VolumesActionsTest-815942062 tempest-VolumesActionsTest-815942062-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d496845-40fd-4062-91e7-693c7db8a4f3" status: 404 len: 111 microversion: 2.1 time: 0.135900 Apr 11 17:26:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 343/1020] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:26:18 2023] GET /compute/v2.1/servers/8d496845-40fd-4062-91e7-693c7db8a4f3 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:26:33 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:26:33 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-bb8fbeee-8906-4709-b974-a0f73c67cbcf tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8" status: 200 len: 1705 microversion: 2.20 time: 0.495976 Apr 11 17:26:33 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 339/1021] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:26:33 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => generated 1705 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:26:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b3e73556-bdc4-40f5-9423-0ec2432218cf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:37 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-b3e73556-bdc4-40f5-9423-0ec2432218cf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:37 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:37 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3e73556-bdc4-40f5-9423-0ec2432218cf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3e73556-bdc4-40f5-9423-0ec2432218cf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3e73556-bdc4-40f5-9423-0ec2432218cf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3e73556-bdc4-40f5-9423-0ec2432218cf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3e73556-bdc4-40f5-9423-0ec2432218cf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3e73556-bdc4-40f5-9423-0ec2432218cf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b3e73556-bdc4-40f5-9423-0ec2432218cf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057230 Apr 11 17:26:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 340/1022] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:26:37 2023] GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:26:37 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:37 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:37 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:37 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:37 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:37 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:26:38 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-865b97b1-bfc9-49bd-a711-825b58f30b91 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0" status: 204 len: 0 microversion: 2.1 time: 0.465775 Apr 11 17:26:38 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 344/1023] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:26:37 2023] DELETE /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:26:38 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-391c609b-f153-445c-ad4e-727603927fbf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:38 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-391c609b-f153-445c-ad4e-727603927fbf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-391c609b-f153-445c-ad4e-727603927fbf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-391c609b-f153-445c-ad4e-727603927fbf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-391c609b-f153-445c-ad4e-727603927fbf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-391c609b-f153-445c-ad4e-727603927fbf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-391c609b-f153-445c-ad4e-727603927fbf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:38 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-391c609b-f153-445c-ad4e-727603927fbf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:38 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-391c609b-f153-445c-ad4e-727603927fbf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:26:38 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-391c609b-f153-445c-ad4e-727603927fbf tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0" status: 200 len: 1672 microversion: 2.1 time: 0.368163 Apr 11 17:26:38 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 340/1024] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:26:38 2023] GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0 => generated 1672 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:26:39 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f0853-b703-414b-ba98-72215c25f3c0", "name": "network-vif-unplugged", "status": "completed", "tag": "50e996b3-f103-493c-8b71-348061a520b0"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:26:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] Creating event network-vif-unplugged:50e996b3-f103-493c-8b71-348061a520b0 for instance 3b9f0853-b703-414b-ba98-72215c25f3c0 on user Apr 11 17:26:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-7248da15-3d6b-43d6-9141-4218f88ceb5d req-30cb6bf6-bab1-4dd4-aa33-a0287feb2392 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050160 Apr 11 17:26:39 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 341/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:26:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:26:41 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-1c140259-4ce9-4293-92a5-347576ffe9f0 req-10b5856a-31d5-4e1f-aa4d-aaed26d60b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f0853-b703-414b-ba98-72215c25f3c0", "name": "network-vif-deleted", "tag": "50e996b3-f103-493c-8b71-348061a520b0"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:26:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1c140259-4ce9-4293-92a5-347576ffe9f0 req-10b5856a-31d5-4e1f-aa4d-aaed26d60b26 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1c140259-4ce9-4293-92a5-347576ffe9f0 req-10b5856a-31d5-4e1f-aa4d-aaed26d60b26 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-1c140259-4ce9-4293-92a5-347576ffe9f0 req-10b5856a-31d5-4e1f-aa4d-aaed26d60b26 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:41 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-1c140259-4ce9-4293-92a5-347576ffe9f0 req-10b5856a-31d5-4e1f-aa4d-aaed26d60b26 service nova] Creating event network-vif-deleted:50e996b3-f103-493c-8b71-348061a520b0 for instance 3b9f0853-b703-414b-ba98-72215c25f3c0 on user Apr 11 17:26:41 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-1c140259-4ce9-4293-92a5-347576ffe9f0 req-10b5856a-31d5-4e1f-aa4d-aaed26d60b26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037066 Apr 11 17:26:41 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 345/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:26:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:26:41 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9f0853-b703-414b-ba98-72215c25f3c0", "name": "network-vif-plugged", "status": "completed", "tag": "50e996b3-f103-493c-8b71-348061a520b0"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:26:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:41 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] Creating event network-vif-plugged:50e996b3-f103-493c-8b71-348061a520b0 for instance 3b9f0853-b703-414b-ba98-72215c25f3c0 on user Apr 11 17:26:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-ec41bf76-9d2e-4ffa-b798-9894ef9778f9 req-2a67cf26-f5f5-4674-99c8-fbf687452114 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038505 Apr 11 17:26:41 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 341/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:26:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=8 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:50 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HTTP exception thrown: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Request method failure captured: Apr 11 17:26:50 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d HTTP/1.1 Apr 11 17:26:50 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:26:50 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:26:50 user devstack@n-api.service[61422]: Connection: close Apr 11 17:26:50 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:26:50 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:26:50 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:26:50 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:26:50 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLGpirdpLMj_i7NmajlEExMFHxHhn207qLd6HDD9DGPXvMYZSXRyXSPGW2x2an54vs9P5g-3SjyYEOq7KG8BtE52dRs5qFDJCHgjHfrrvaa4ZwoqfQbMSDFZua72G9LhvghdNETCx2RnS9-0RFdD64DirN9EirvB4gv6s_wo7I8RDU Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Project-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}] Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Tenant: tempest-ServerActionsTestJSON-499420188 Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Tenant-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:26:50 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:26:50 user devstack@n-api.service[61422]: X-User: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:26:50 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:26:50 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:26:50 user devstack@n-api.service[61422]: X-User-Id: 8f4ba7d7f3f74b5c800be2408c1035e2 Apr 11 17:26:50 user devstack@n-api.service[61422]: X-User-Name: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:26:50 user devstack@n-api.service[61422]: method: > Apr 11 17:26:50 user devstack@n-api.service[61422]: exception: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61422]: action_args: {'id': '40270cb6-8b7f-4658-8ea8-17a800d63f2d'} Apr 11 17:26:50 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Returning 404 to user: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:26:50 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-25646c0d-a866-41be-ba78-8b3cf53edc70 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 404 len: 111 microversion: 2.1 time: 0.038096 Apr 11 17:26:50 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 342/1028] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:26:50 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:50 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HTTP exception thrown: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Request method failure captured: Apr 11 17:26:50 user devstack@n-api.service[61424]: request: DELETE /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d HTTP/1.1 Apr 11 17:26:50 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:26:50 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:26:50 user devstack@n-api.service[61424]: Connection: close Apr 11 17:26:50 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:26:50 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:26:50 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:26:50 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:26:50 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZLGpirdpLMj_i7NmajlEExMFHxHhn207qLd6HDD9DGPXvMYZSXRyXSPGW2x2an54vs9P5g-3SjyYEOq7KG8BtE52dRs5qFDJCHgjHfrrvaa4ZwoqfQbMSDFZua72G9LhvghdNETCx2RnS9-0RFdD64DirN9EirvB4gv6s_wo7I8RDU Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Project-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Project-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}] Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Tenant: tempest-ServerActionsTestJSON-499420188 Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Tenant-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:26:50 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:26:50 user devstack@n-api.service[61424]: X-User: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:26:50 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:26:50 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:26:50 user devstack@n-api.service[61424]: X-User-Id: 8f4ba7d7f3f74b5c800be2408c1035e2 Apr 11 17:26:50 user devstack@n-api.service[61424]: X-User-Name: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:26:50 user devstack@n-api.service[61424]: method: > Apr 11 17:26:50 user devstack@n-api.service[61424]: exception: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61424]: action_args: {'id': '40270cb6-8b7f-4658-8ea8-17a800d63f2d'} Apr 11 17:26:50 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Returning 404 to user: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:26:50 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-21e24752-be6c-4239-ab8e-6f25dd0bd935 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 404 len: 111 microversion: 2.1 time: 0.030715 Apr 11 17:26:50 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 346/1029] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:26:50 2023] DELETE /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:26:50 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:50 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 40270cb6-8b7f-4658-8ea8-17a800d63f2d] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:50 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HTTP exception thrown: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Request method failure captured: Apr 11 17:26:50 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d HTTP/1.1 Apr 11 17:26:50 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:26:50 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:26:50 user devstack@n-api.service[61423]: Connection: close Apr 11 17:26:50 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:26:50 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:26:50 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:26:50 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:26:50 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLGpirdpLMj_i7NmajlEExMFHxHhn207qLd6HDD9DGPXvMYZSXRyXSPGW2x2an54vs9P5g-3SjyYEOq7KG8BtE52dRs5qFDJCHgjHfrrvaa4ZwoqfQbMSDFZua72G9LhvghdNETCx2RnS9-0RFdD64DirN9EirvB4gv6s_wo7I8RDU Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Project-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Project-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}] Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Tenant: tempest-ServerActionsTestJSON-499420188 Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Tenant-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:26:50 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:26:50 user devstack@n-api.service[61423]: X-User: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:26:50 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:26:50 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:26:50 user devstack@n-api.service[61423]: X-User-Id: 8f4ba7d7f3f74b5c800be2408c1035e2 Apr 11 17:26:50 user devstack@n-api.service[61423]: X-User-Name: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:26:50 user devstack@n-api.service[61423]: method: > Apr 11 17:26:50 user devstack@n-api.service[61423]: exception: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61423]: action_args: {'id': '40270cb6-8b7f-4658-8ea8-17a800d63f2d'} Apr 11 17:26:50 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. Apr 11 17:26:50 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:26:50 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Returning 404 to user: Instance 40270cb6-8b7f-4658-8ea8-17a800d63f2d could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:26:50 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-5347ed2b-8523-4d69-aa60-f407910d00ff tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d" status: 404 len: 111 microversion: 2.1 time: 0.040265 Apr 11 17:26:50 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 342/1030] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:26:50 2023] GET /compute/v2.1/servers/40270cb6-8b7f-4658-8ea8-17a800d63f2d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:50 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:26:50 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-027541b8-ed4c-408f-9464-d010245ecfc8 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1" status: 204 len: 0 microversion: 2.1 time: 0.112736 Apr 11 17:26:50 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 343/1031] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:26:50 2023] DELETE /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c82c58c3-a154-41ee-b2f7-0c96cc315cb6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c82c58c3-a154-41ee-b2f7-0c96cc315cb6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c82c58c3-a154-41ee-b2f7-0c96cc315cb6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c82c58c3-a154-41ee-b2f7-0c96cc315cb6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c82c58c3-a154-41ee-b2f7-0c96cc315cb6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c82c58c3-a154-41ee-b2f7-0c96cc315cb6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c82c58c3-a154-41ee-b2f7-0c96cc315cb6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:50 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c82c58c3-a154-41ee-b2f7-0c96cc315cb6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:51 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-c82c58c3-a154-41ee-b2f7-0c96cc315cb6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f4ba7d7f3f74b5c800be2408c1035e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db242f5f39d94966948e8b487cd52d0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:26:51 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c82c58c3-a154-41ee-b2f7-0c96cc315cb6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1" status: 200 len: 1547 microversion: 2.1 time: 0.173797 Apr 11 17:26:51 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 347/1032] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:26:50 2023] GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1 => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:26:51 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a306a5-f981-495f-9f3a-8fd5011b4ce1", "name": "network-vif-unplugged", "status": "completed", "tag": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:26:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:51 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:51 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] Creating event network-vif-unplugged:2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 on user Apr 11 17:26:51 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-d02c54ba-3952-4497-ab9b-9608858bde7f req-703dc4ea-0f5f-4c08-8156-82f29523dae3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029397 Apr 11 17:26:51 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 343/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:26:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:26:53 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70a306a5-f981-495f-9f3a-8fd5011b4ce1", "name": "network-vif-plugged", "status": "completed", "tag": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879"}, {"server_uuid": "70a306a5-f981-495f-9f3a-8fd5011b4ce1", "name": "network-vif-deleted", "tag": "2a3246a9-9ae1-4f3e-9e23-37c3702e9879"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:26:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:26:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:26:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:26:53 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] Creating event network-vif-plugged:2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 on user Apr 11 17:26:53 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] Creating event network-vif-deleted:2a3246a9-9ae1-4f3e-9e23-37c3702e9879 for instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 on user Apr 11 17:26:53 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-265bd75f-80fe-4ffe-9e67-8023f348832c req-575e61c3-4c7a-4056-b184-6434bb46e4df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030418 Apr 11 17:26:53 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 344/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:26:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:13 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:13 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:13 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-3d5f0a90-42ec-40f8-9275-17d275b83857 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:13 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-3d5f0a90-42ec-40f8-9275-17d275b83857 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3d5f0a90-42ec-40f8-9275-17d275b83857 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3d5f0a90-42ec-40f8-9275-17d275b83857 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3d5f0a90-42ec-40f8-9275-17d275b83857 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3d5f0a90-42ec-40f8-9275-17d275b83857 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3d5f0a90-42ec-40f8-9275-17d275b83857 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:13 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-3d5f0a90-42ec-40f8-9275-17d275b83857 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:13 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-3d5f0a90-42ec-40f8-9275-17d275b83857 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:27:13 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-3d5f0a90-42ec-40f8-9275-17d275b83857 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96" status: 200 len: 1440 microversion: 2.1 time: 0.202420 Apr 11 17:27:13 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 348/1035] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:27:13 2023] GET /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96 => generated 1440 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:27:15 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=10 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:15 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=18 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:15 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d4f216a-af3c-485b-898a-64a2302b8a96", "tag": "ad0ff01a-d361-4eb0-af56-2afe1460be14"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:15 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:15 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:15 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:15 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] Creating event network-changed:ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance 9d4f216a-af3c-485b-898a-64a2302b8a96 on user Apr 11 17:27:15 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-3c9a0336-2e37-4f23-ab0d-41b19ddfbe75 req-fe479e0a-604a-4136-bbb9-3f6f734f36e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034867 Apr 11 17:27:15 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 344/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:27:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:16 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:16 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7beb721e-6c1d-4427-8dd9-5a1f1abbd0fa tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1809168048"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:16 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-7beb721e-6c1d-4427-8dd9-5a1f1abbd0fa tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7beb721e-6c1d-4427-8dd9-5a1f1abbd0fa tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7beb721e-6c1d-4427-8dd9-5a1f1abbd0fa tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7beb721e-6c1d-4427-8dd9-5a1f1abbd0fa tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7beb721e-6c1d-4427-8dd9-5a1f1abbd0fa tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7beb721e-6c1d-4427-8dd9-5a1f1abbd0fa tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7beb721e-6c1d-4427-8dd9-5a1f1abbd0fa tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:16 user devstack@n-api.service[61422]: INFO nova.network.security_group_api [None req-7beb721e-6c1d-4427-8dd9-5a1f1abbd0fa tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Removing security group 430bbc5a-523b-41c2-8138-cf4beb2b791c from port 9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d4f216a-af3c-485b-898a-64a2302b8a96", "tag": "ad0ff01a-d361-4eb0-af56-2afe1460be14"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:16 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:16 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:16 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] Creating event network-changed:ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance 9d4f216a-af3c-485b-898a-64a2302b8a96 on user Apr 11 17:27:16 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-58c33cad-3e08-409f-a309-061dd21bb80a req-dcce499f-9709-4627-b289-edd96f87af8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030408 Apr 11 17:27:16 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 345/1037] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:27:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:16 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:27:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-cf95abc4-e4b7-46d0-9cdd-9283631a82de tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96" status: 204 len: 0 microversion: 2.1 time: 0.154432 Apr 11 17:27:16 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 349/1038] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:27:16 2023] DELETE /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-4ff6bad4-8092-40c4-8bef-5338620b5601 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-4ff6bad4-8092-40c4-8bef-5338620b5601 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4ff6bad4-8092-40c4-8bef-5338620b5601 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4ff6bad4-8092-40c4-8bef-5338620b5601 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4ff6bad4-8092-40c4-8bef-5338620b5601 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4ff6bad4-8092-40c4-8bef-5338620b5601 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4ff6bad4-8092-40c4-8bef-5338620b5601 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-4ff6bad4-8092-40c4-8bef-5338620b5601 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:16 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-4ff6bad4-8092-40c4-8bef-5338620b5601 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:27:16 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-4ff6bad4-8092-40c4-8bef-5338620b5601 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96" status: 200 len: 1564 microversion: 2.1 time: 0.252976 Apr 11 17:27:16 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 346/1039] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:27:16 2023] GET /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96 => generated 1564 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:27:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7beb721e-6c1d-4427-8dd9-5a1f1abbd0fa tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/action" status: 202 len: 0 microversion: 2.1 time: 1.440503 Apr 11 17:27:17 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 345/1040] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 17:27:16 2023] POST /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/action => generated 0 bytes in 1442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:27:17 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4f216a-af3c-485b-898a-64a2302b8a96", "name": "network-vif-unplugged", "status": "completed", "tag": "ad0ff01a-d361-4eb0-af56-2afe1460be14"}, {"name": "network-changed", "server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:17 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Creating event network-vif-unplugged:ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance 9d4f216a-af3c-485b-898a-64a2302b8a96 on user Apr 11 17:27:17 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] Creating event network-changed:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:27:17 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-a6ef50df-f3b8-46c0-b2dd-b4a75d613966 req-0bb6313c-d9fc-4e59-8ba0-865674f6e3de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.046593 Apr 11 17:27:17 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 350/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:27:17 2023] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:18 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:18 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:19 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:19 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] Creating event network-changed:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:27:19 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-cea47ac8-d143-492e-9d48-8e66706b8a5f req-2b14f663-8757-4d5a-9b0f-786523358936 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031058 Apr 11 17:27:19 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 346/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:27:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:19 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lazy-loading 'services' on Instance uuid 7b2cc7a5-a96b-426e-852c-39b011fe2a53 {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:27:19 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2d950159-3325-40c6-a848-02b35f8d8391 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/os-volume_attachments/b2785e1a-385f-4f66-b8fa-db0f5963af98" status: 202 len: 0 microversion: 2.1 time: 0.175663 Apr 11 17:27:19 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 347/1043] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:27:18 2023] DELETE /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/os-volume_attachments/b2785e1a-385f-4f66-b8fa-db0f5963af98 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:27:19 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-76b17909-479b-4339-bd68-d658f0a281c9 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:19 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-76b17909-479b-4339-bd68-d658f0a281c9 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76b17909-479b-4339-bd68-d658f0a281c9 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76b17909-479b-4339-bd68-d658f0a281c9 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76b17909-479b-4339-bd68-d658f0a281c9 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76b17909-479b-4339-bd68-d658f0a281c9 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76b17909-479b-4339-bd68-d658f0a281c9 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:19 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-76b17909-479b-4339-bd68-d658f0a281c9 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:19 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-76b17909-479b-4339-bd68-d658f0a281c9 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057832 Apr 11 17:27:19 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 351/1044] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:27:19 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:19 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d4f216a-af3c-485b-898a-64a2302b8a96", "name": "network-vif-plugged", "status": "completed", "tag": "ad0ff01a-d361-4eb0-af56-2afe1460be14"}, {"server_uuid": "9d4f216a-af3c-485b-898a-64a2302b8a96", "name": "network-vif-deleted", "tag": "ad0ff01a-d361-4eb0-af56-2afe1460be14"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] Creating event network-vif-plugged:ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance 9d4f216a-af3c-485b-898a-64a2302b8a96 on user Apr 11 17:27:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] Creating event network-vif-deleted:ad0ff01a-d361-4eb0-af56-2afe1460be14 for instance 9d4f216a-af3c-485b-898a-64a2302b8a96 on user Apr 11 17:27:20 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-d5ded591-fdb5-4fd0-972c-2ed39321ee16 req-8df41b11-c66f-413d-b8ef-67a0326f83c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036833 Apr 11 17:27:20 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 347/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:27:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:28 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:27:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:27:28 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0 HTTP/1.1 Apr 11 17:27:28 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:27:28 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:27:28 user devstack@n-api.service[61423]: Connection: close Apr 11 17:27:28 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:27:28 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:27:28 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:27:28 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:27:28 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:27:28 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:27:28 user devstack@n-api.service[61423]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:27:28 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:27:28 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:27:28 user devstack@n-api.service[61423]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:27:28 user devstack@n-api.service[61423]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:27:28 user devstack@n-api.service[61423]: method: > Apr 11 17:27:28 user devstack@n-api.service[61423]: exception: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:27:28 user devstack@n-api.service[61423]: action_args: {'id': '3b9f0853-b703-414b-ba98-72215c25f3c0'} Apr 11 17:27:28 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:27:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:27:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:27:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-bd8137ec-3d29-43bc-af3c-8e4d43c2e04d tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0" status: 404 len: 111 microversion: 2.1 time: 0.031273 Apr 11 17:27:28 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 348/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:27:28 2023] GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:27:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-30bb3dfd-2ee9-4945-98a0-ec7586bf4421 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '.version_select at 0x7f5bdd8e3010>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-30bb3dfd-2ee9-4945-98a0-ec7586bf4421 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451399098" status: 202 len: 0 microversion: 2.1 time: 0.027018 Apr 11 17:27:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 352/1047] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 17:27:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451399098 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:27:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7e343e4f-de31-483e-988d-7d18b24d7428 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd6f6cb0>, body: {"keypair": {"name": "tempest-keypair-50229463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjg6y5c4bWzxie1RNFs/ruXDTwr9qyR6V7QApxc9dx7meAMZb0t2pHrv+9TjRRauBB9uzs9qyo+QKd+sjmfFNUwSjqtKGcMeN9je+lKciRvzvtoxCGx3G5zz+z8zj+Lag=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:29 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-7e343e4f-de31-483e-988d-7d18b24d7428 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for project 23c663a759724bbda32f189ceedf6675. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:27:29 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-7e343e4f-de31-483e-988d-7d18b24d7428 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for user ff27d08254f74491aba3386c9b901300 and project 23c663a759724bbda32f189ceedf6675. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:27:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7e343e4f-de31-483e-988d-7d18b24d7428 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.056431 Apr 11 17:27:29 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 348/1048] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:27:29 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1832781409", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f6d30218-0af4-4ce4-bb7e-990a43a37ec2"}], "security_groups": [{"name": "tempest-securitygroup--1140842230"}], "key_name": "tempest-keypair-50229463", "user_data": "}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] validate_networks() for [('f6d30218-0af4-4ce4-bb7e-990a43a37ec2', None, None, None, None, None)] {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for project 23c663a759724bbda32f189ceedf6675. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Getting quotas for user ff27d08254f74491aba3386c9b901300 and project 23c663a759724bbda32f189ceedf6675. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:27:31 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:27:31 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ae434b71-ade5-4f58-9e6a-3f237abe5313 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.584888 Apr 11 17:27:31 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 349/1049] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:27:31 2023] POST /compute/v2.1/servers => generated 400 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:27:31 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-1f4b705f-9438-4f9c-9777-0328f3e7cf8f tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:31 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-1f4b705f-9438-4f9c-9777-0328f3e7cf8f tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:31 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-1f4b705f-9438-4f9c-9777-0328f3e7cf8f tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:27:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-1f4b705f-9438-4f9c-9777-0328f3e7cf8f tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730" status: 200 len: 1234 microversion: 2.1 time: 0.077737 Apr 11 17:27:31 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 353/1050] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:27:31 2023] GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730 => generated 1234 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=8 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e00fcc65-7c52-4c46-a3ca-fccff3491147 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e00fcc65-7c52-4c46-a3ca-fccff3491147 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e00fcc65-7c52-4c46-a3ca-fccff3491147 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e00fcc65-7c52-4c46-a3ca-fccff3491147 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e00fcc65-7c52-4c46-a3ca-fccff3491147 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e00fcc65-7c52-4c46-a3ca-fccff3491147 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e00fcc65-7c52-4c46-a3ca-fccff3491147 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e00fcc65-7c52-4c46-a3ca-fccff3491147 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e00fcc65-7c52-4c46-a3ca-fccff3491147 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.065521 Apr 11 17:27:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 349/1051] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 17:27:34 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:27:34 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:34 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:34 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:34 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:27:34 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-84ae85a3-b294-42d4-9e7f-1c39663689af tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8" status: 204 len: 0 microversion: 2.20 time: 0.145079 Apr 11 17:27:34 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 350/1052] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:27:34 2023] DELETE /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:27:34 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:34 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:34 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "name": "network-vif-unplugged", "status": "completed", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] Creating event network-vif-unplugged:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:27:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-813004c9-7696-4151-a859-20675109fa5f req-9903b5ac-dbf1-4bc8-9fc7-45493e702fc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036184 Apr 11 17:27:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 350/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:27:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:35 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d149c96-1eca-4e4c-8165-e56fcfb1f730", "tag": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:35 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:27:35 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:27:35 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b69069a1461d485598e2078cc12772a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce268052b8046e5a7efa41048e96645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:27:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-5622e31c-8fdf-42cd-a04c-8084722dcb24 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8" status: 200 len: 1711 microversion: 2.20 time: 0.637232 Apr 11 17:27:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:35 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 354/1054] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:27:34 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => generated 1711 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 17:27:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:35 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:35 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] Creating event network-changed:2b3a5d7c-36dd-4752-81ff-b52dd20899e1 for instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 on user Apr 11 17:27:35 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-2e995c33-8324-4469-962e-7e04a620a6b1 req-896ac8ea-a067-4124-81f9-7cfe274194c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041481 Apr 11 17:27:35 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 351/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:27:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:35 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-e8f88266-8146-4e77-ba17-ab10b951b589 req-9959dca3-7a28-4f22-ad07-99ad8e201b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "name": "network-vif-deleted", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e8f88266-8146-4e77-ba17-ab10b951b589 req-9959dca3-7a28-4f22-ad07-99ad8e201b4b service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e8f88266-8146-4e77-ba17-ab10b951b589 req-9959dca3-7a28-4f22-ad07-99ad8e201b4b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:35 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-e8f88266-8146-4e77-ba17-ab10b951b589 req-9959dca3-7a28-4f22-ad07-99ad8e201b4b service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-e8f88266-8146-4e77-ba17-ab10b951b589 req-9959dca3-7a28-4f22-ad07-99ad8e201b4b service nova] Creating event network-vif-deleted:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:27:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-e8f88266-8146-4e77-ba17-ab10b951b589 req-9959dca3-7a28-4f22-ad07-99ad8e201b4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039487 Apr 11 17:27:36 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 351/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:27:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:27:36 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c59a1a-121c-41c4-8ca4-b6675b5191c8", "name": "network-vif-plugged", "status": "completed", "tag": "9f57f039-208c-41c2-93cd-7df0ca44218f"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:36 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:36 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] Creating event network-vif-plugged:9f57f039-208c-41c2-93cd-7df0ca44218f for instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 on user Apr 11 17:27:36 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-672b0780-1c0a-45e7-b580-cb83df2a86d6 req-faf8ea41-a997-4baa-b1d1-4cf56fc2cf53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028960 Apr 11 17:27:36 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 355/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:27:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d149c96-1eca-4e4c-8165-e56fcfb1f730", "name": "network-vif-plugged", "status": "completed", "tag": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] Creating event network-vif-plugged:2b3a5d7c-36dd-4752-81ff-b52dd20899e1 for instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 on user Apr 11 17:27:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-5bfaa347-7a53-4e77-83d3-9a922f061b9a req-ed8224fb-03cf-4488-8b58-c29e927d6095 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071737 Apr 11 17:27:37 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 352/1058] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:27:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:39 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d149c96-1eca-4e4c-8165-e56fcfb1f730", "name": "network-vif-plugged", "status": "completed", "tag": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:27:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] Creating event network-vif-plugged:2b3a5d7c-36dd-4752-81ff-b52dd20899e1 for instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 on user Apr 11 17:27:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-916c0bf4-911c-48cb-b1d0-99751a1631aa req-dde69c5c-cdbe-4934-bdfe-c53eb58907b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028743 Apr 11 17:27:39 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 352/1059] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:27:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:27:41 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:41 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 70a306a5-f981-495f-9f3a-8fd5011b4ce1] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:41 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HTTP exception thrown: Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 could not be found. Apr 11 17:27:41 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Request method failure captured: Apr 11 17:27:41 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1 HTTP/1.1 Apr 11 17:27:41 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:27:41 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:27:41 user devstack@n-api.service[61424]: Connection: close Apr 11 17:27:41 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:27:41 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:27:41 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:27:41 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:27:41 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZLGpirdpLMj_i7NmajlEExMFHxHhn207qLd6HDD9DGPXvMYZSXRyXSPGW2x2an54vs9P5g-3SjyYEOq7KG8BtE52dRs5qFDJCHgjHfrrvaa4ZwoqfQbMSDFZua72G9LhvghdNETCx2RnS9-0RFdD64DirN9EirvB4gv6s_wo7I8RDU Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Project-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Project-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}] Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Tenant: tempest-ServerActionsTestJSON-499420188 Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Tenant-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:27:41 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:27:41 user devstack@n-api.service[61424]: X-User: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:27:41 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:27:41 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:27:41 user devstack@n-api.service[61424]: X-User-Id: 8f4ba7d7f3f74b5c800be2408c1035e2 Apr 11 17:27:41 user devstack@n-api.service[61424]: X-User-Name: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:27:41 user devstack@n-api.service[61424]: method: > Apr 11 17:27:41 user devstack@n-api.service[61424]: exception: Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 could not be found. Apr 11 17:27:41 user devstack@n-api.service[61424]: action_args: {'id': '70a306a5-f981-495f-9f3a-8fd5011b4ce1'} Apr 11 17:27:41 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 could not be found. Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 could not be found. Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 could not be found. Apr 11 17:27:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:27:41 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Returning 404 to user: Instance 70a306a5-f981-495f-9f3a-8fd5011b4ce1 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:27:41 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-f74606b6-1438-4b0a-8cf6-0220601109d6 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1" status: 404 len: 111 microversion: 2.1 time: 0.036281 Apr 11 17:27:41 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 356/1060] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:27:41 2023] GET /compute/v2.1/servers/70a306a5-f981-495f-9f3a-8fd5011b4ce1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HTTP exception thrown: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Request method failure captured: Apr 11 17:27:43 user devstack@n-api.service[61423]: request: DELETE /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a HTTP/1.1 Apr 11 17:27:43 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:27:43 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:27:43 user devstack@n-api.service[61423]: Connection: close Apr 11 17:27:43 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:27:43 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:27:43 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:27:43 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:27:43 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZLGpirdpLMj_i7NmajlEExMFHxHhn207qLd6HDD9DGPXvMYZSXRyXSPGW2x2an54vs9P5g-3SjyYEOq7KG8BtE52dRs5qFDJCHgjHfrrvaa4ZwoqfQbMSDFZua72G9LhvghdNETCx2RnS9-0RFdD64DirN9EirvB4gv6s_wo7I8RDU Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Project-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Project-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}] Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Tenant: tempest-ServerActionsTestJSON-499420188 Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Tenant-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:27:43 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:27:43 user devstack@n-api.service[61423]: X-User: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:27:43 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:27:43 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:27:43 user devstack@n-api.service[61423]: X-User-Id: 8f4ba7d7f3f74b5c800be2408c1035e2 Apr 11 17:27:43 user devstack@n-api.service[61423]: X-User-Name: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:27:43 user devstack@n-api.service[61423]: method: > Apr 11 17:27:43 user devstack@n-api.service[61423]: exception: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:27:43 user devstack@n-api.service[61423]: action_args: {'id': '1fc7677c-cbd9-48e7-be62-2210074bc87a'} Apr 11 17:27:43 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:27:43 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:27:43 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Returning 404 to user: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:27:43 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ce64e7fd-8c08-43c6-8ee7-f57a1dd53b16 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 404 len: 111 microversion: 2.1 time: 0.032662 Apr 11 17:27:43 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 353/1061] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:27:43 2023] DELETE /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:27:43 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:43 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:43 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] [instance: 1fc7677c-cbd9-48e7-be62-2210074bc87a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:27:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:27:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:27:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:27:43 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] HTTP exception thrown: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:27:43 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Request method failure captured: Apr 11 17:27:43 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a HTTP/1.1 Apr 11 17:27:43 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:27:43 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:27:43 user devstack@n-api.service[61422]: Connection: close Apr 11 17:27:43 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:27:43 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:27:43 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:27:43 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:27:43 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZLGpirdpLMj_i7NmajlEExMFHxHhn207qLd6HDD9DGPXvMYZSXRyXSPGW2x2an54vs9P5g-3SjyYEOq7KG8BtE52dRs5qFDJCHgjHfrrvaa4ZwoqfQbMSDFZua72G9LhvghdNETCx2RnS9-0RFdD64DirN9EirvB4gv6s_wo7I8RDU Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Project-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db242f5f39d94966948e8b487cd52d0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db242f5f39d94966948e8b487cd52d0c"}]}] Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Tenant: tempest-ServerActionsTestJSON-499420188 Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Tenant-Id: db242f5f39d94966948e8b487cd52d0c Apr 11 17:27:43 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServerActionsTestJSON-499420188 Apr 11 17:27:43 user devstack@n-api.service[61422]: X-User: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:27:43 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:27:43 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:27:43 user devstack@n-api.service[61422]: X-User-Id: 8f4ba7d7f3f74b5c800be2408c1035e2 Apr 11 17:27:43 user devstack@n-api.service[61422]: X-User-Name: tempest-ServerActionsTestJSON-499420188-project-member Apr 11 17:27:43 user devstack@n-api.service[61422]: method: > Apr 11 17:27:43 user devstack@n-api.service[61422]: exception: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:27:43 user devstack@n-api.service[61422]: action_args: {'id': '1fc7677c-cbd9-48e7-be62-2210074bc87a'} Apr 11 17:27:43 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. Apr 11 17:27:43 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:27:43 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Returning 404 to user: Instance 1fc7677c-cbd9-48e7-be62-2210074bc87a could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:27:43 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-01152850-4953-45e8-9ebc-444e3f42616b tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a" status: 404 len: 111 microversion: 2.1 time: 0.034655 Apr 11 17:27:43 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 353/1062] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:27:43 2023] GET /compute/v2.1/servers/1fc7677c-cbd9-48e7-be62-2210074bc87a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:27:43 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ba263839-1651-4160-8e01-5051f0842c11 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] Calling method '.version_select at 0x7f5bdd791480>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:27:43 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:27:43 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ba263839-1651-4160-8e01-5051f0842c11 tempest-ServerActionsTestJSON-499420188 tempest-ServerActionsTestJSON-499420188-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019962913" status: 202 len: 0 microversion: 2.1 time: 0.026269 Apr 11 17:27:43 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 357/1063] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 17:27:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019962913 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1316453602", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG nova.network.neutron [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] validate_networks() for None {{(pid=61423) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Flavor limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Image limits 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Flavor pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Image pref 0:0:0 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG nova.virt.hardware [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61423) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Getting quotas for project 0f8aed1a07fb4244ad9ec8c8d9816a27. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG nova.quota [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Getting quotas for user cde9c28bb4f84dc7bb865446203e54eb and project 0f8aed1a07fb4244ad9ec8c8d9816a27. Resources: {'cores', 'instances', 'ram'} {{(pid=61423) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Going to run 1 instances... {{(pid=61423) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:28:00 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61423) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:28:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-c23c28af-9ab3-43d6-ac64-fc3495e63324 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.455069 Apr 11 17:28:00 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 354/1064] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:28:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:28:00 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7a7aad78-b1de-483f-90b5-1fda08c985ac tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:00 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-7a7aad78-b1de-483f-90b5-1fda08c985ac tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:00 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:00 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=14 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:00 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-7a7aad78-b1de-483f-90b5-1fda08c985ac tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9c28bb4f84dc7bb865446203e54eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8aed1a07fb4244ad9ec8c8d9816a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:28:00 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7a7aad78-b1de-483f-90b5-1fda08c985ac tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bee1911-3859-4292-8bc5-4572963aa007" status: 200 len: 1209 microversion: 2.1 time: 0.070865 Apr 11 17:28:00 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 354/1065] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:28:00 2023] GET /compute/v2.1/servers/8bee1911-3859-4292-8bc5-4572963aa007 => generated 1209 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:28:03 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bee1911-3859-4292-8bc5-4572963aa007", "tag": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:28:03 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=10 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:03 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:03 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:03 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] Creating event network-changed:c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 for instance 8bee1911-3859-4292-8bc5-4572963aa007 on user Apr 11 17:28:03 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-3d5c3fc0-cfa5-49e0-8dd0-5a7a39bea3ed req-7cb7214a-8ac0-45c5-ae08-6ed601afbb7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044039 Apr 11 17:28:03 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 358/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:28:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:28:05 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bee1911-3859-4292-8bc5-4572963aa007", "name": "network-vif-plugged", "status": "completed", "tag": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:28:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:05 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:05 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] Creating event network-vif-plugged:c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 for instance 8bee1911-3859-4292-8bc5-4572963aa007 on user Apr 11 17:28:05 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-b0337d70-ffc4-4f7b-a997-12e198f47ae7 req-93920665-d078-435f-a160-afbdd535ee48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032669 Apr 11 17:28:05 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 355/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:28:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:28:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:07 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 9d4f216a-af3c-485b-898a-64a2302b8a96] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance 9d4f216a-af3c-485b-898a-64a2302b8a96 could not be found. Apr 11 17:28:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:28:07 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96 HTTP/1.1 Apr 11 17:28:07 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:28:07 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:28:07 user devstack@n-api.service[61422]: Connection: close Apr 11 17:28:07 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:28:07 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:28:07 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:28:07 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:28:07 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:28:07 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:28:07 user devstack@n-api.service[61422]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:28:07 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:28:07 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:28:07 user devstack@n-api.service[61422]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:28:07 user devstack@n-api.service[61422]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:28:07 user devstack@n-api.service[61422]: method: > Apr 11 17:28:07 user devstack@n-api.service[61422]: exception: Instance 9d4f216a-af3c-485b-898a-64a2302b8a96 could not be found. Apr 11 17:28:07 user devstack@n-api.service[61422]: action_args: {'id': '9d4f216a-af3c-485b-898a-64a2302b8a96'} Apr 11 17:28:07 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d4f216a-af3c-485b-898a-64a2302b8a96 could not be found. Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d4f216a-af3c-485b-898a-64a2302b8a96 could not be found. Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d4f216a-af3c-485b-898a-64a2302b8a96 could not be found. Apr 11 17:28:07 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance 9d4f216a-af3c-485b-898a-64a2302b8a96 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:28:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-149a0ff1-d5cd-43e6-90af-bf569c9301d5 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96" status: 404 len: 111 microversion: 2.1 time: 0.026345 Apr 11 17:28:07 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 355/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:28:07 2023] GET /compute/v2.1/servers/9d4f216a-af3c-485b-898a-64a2302b8a96 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:28:07 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bee1911-3859-4292-8bc5-4572963aa007", "name": "network-vif-plugged", "status": "completed", "tag": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:28:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:07 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] Creating event network-vif-plugged:c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 for instance 8bee1911-3859-4292-8bc5-4572963aa007 on user Apr 11 17:28:07 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-6ee04474-68af-4574-9d98-e10086ec5d7e req-1577a497-3fec-4032-98c8-13d562034e78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049332 Apr 11 17:28:07 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 359/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:28:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-f1249cc8-7efd-4136-800c-6cfa7c0e5a11 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-f1249cc8-7efd-4136-800c-6cfa7c0e5a11 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f1249cc8-7efd-4136-800c-6cfa7c0e5a11 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f1249cc8-7efd-4136-800c-6cfa7c0e5a11 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f1249cc8-7efd-4136-800c-6cfa7c0e5a11 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f1249cc8-7efd-4136-800c-6cfa7c0e5a11 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f1249cc8-7efd-4136-800c-6cfa7c0e5a11 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-f1249cc8-7efd-4136-800c-6cfa7c0e5a11 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:09 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-f1249cc8-7efd-4136-800c-6cfa7c0e5a11 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058017 Apr 11 17:28:09 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 356/1070] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:28:09 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:28:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:09 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] HTTP exception thrown: Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 is not attached to volume b2785e1a-385f-4f66-b8fa-db0f5963af98 Apr 11 17:28:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Request method failure captured: Apr 11 17:28:09 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/os-volume_attachments/b2785e1a-385f-4f66-b8fa-db0f5963af98 HTTP/1.1 Apr 11 17:28:09 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:28:09 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:28:09 user devstack@n-api.service[61422]: Connection: close Apr 11 17:28:09 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:28:09 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:28:09 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:28:09 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:28:09 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZYlhmC2oiI6gawAcJGuGfhGnknZ5_xndVlxiBUaQ3wKzuhK4fXibdfH7ZQS_-TN5Szk3SxPMXMnqqbwxxD6ZscmqYMTGl2T0NIK5iZcohVwGGZz6gaUn0krHMhPcd7SmQGQLJe-WjRRr2-_j2Cj8_lU7tYmQyPUfMvs40eq-Xle0Fs Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Project-Id: ab7ce3fc251f4f1eb9151d1ef8c86d91 Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Project-Name: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}] Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Tenant: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Tenant-Id: ab7ce3fc251f4f1eb9151d1ef8c86d91 Apr 11 17:28:09 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:28:09 user devstack@n-api.service[61422]: X-User: tempest-TestMinimumBasicScenario-593818068-project-member Apr 11 17:28:09 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:28:09 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:28:09 user devstack@n-api.service[61422]: X-User-Id: eed61e2d73a84d85a9f5ff2b314624c9 Apr 11 17:28:09 user devstack@n-api.service[61422]: X-User-Name: tempest-TestMinimumBasicScenario-593818068-project-member Apr 11 17:28:09 user devstack@n-api.service[61422]: method: > Apr 11 17:28:09 user devstack@n-api.service[61422]: exception: Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 is not attached to volume b2785e1a-385f-4f66-b8fa-db0f5963af98 Apr 11 17:28:09 user devstack@n-api.service[61422]: action_args: {'server_id': '7b2cc7a5-a96b-426e-852c-39b011fe2a53', 'id': 'b2785e1a-385f-4f66-b8fa-db0f5963af98'} Apr 11 17:28:09 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b2785e1a-385f-4f66-b8fa-db0f5963af98. Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 is not attached to volume b2785e1a-385f-4f66-b8fa-db0f5963af98 Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 is not attached to volume b2785e1a-385f-4f66-b8fa-db0f5963af98 Apr 11 17:28:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Returning 404 to user: Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 is not attached to volume b2785e1a-385f-4f66-b8fa-db0f5963af98 {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:28:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b76c1c79-a873-49e8-9561-a80b32a8dfef tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/os-volume_attachments/b2785e1a-385f-4f66-b8fa-db0f5963af98" status: 404 len: 154 microversion: 2.1 time: 0.108724 Apr 11 17:28:09 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 356/1071] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:28:09 2023] DELETE /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53/os-volume_attachments/b2785e1a-385f-4f66-b8fa-db0f5963af98 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 17:28:09 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:09 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:09 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f054c2a-84ad-48a6-ad76-8aaf5038c210", "tag": "56ae4ea0-6935-4111-9767-36f6e5d04d93"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:09 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] Creating event network-changed:56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 on user Apr 11 17:28:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-f0108968-89f3-40ca-92a7-1724ac97159c req-b20a471f-6124-469b-bb19-bad6cde66404 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031815 Apr 11 17:28:10 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 357/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:28:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:28:10 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:28:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-478c2b26-6978-42b3-9f43-7acf6757ac73 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210" status: 204 len: 0 microversion: 2.1 time: 0.320371 Apr 11 17:28:10 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 360/1073] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:28:09 2023] DELETE /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5d7a0935-1a35-48c9-b2b4-8864d30c7b8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-5d7a0935-1a35-48c9-b2b4-8864d30c7b8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5d7a0935-1a35-48c9-b2b4-8864d30c7b8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5d7a0935-1a35-48c9-b2b4-8864d30c7b8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5d7a0935-1a35-48c9-b2b4-8864d30c7b8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5d7a0935-1a35-48c9-b2b4-8864d30c7b8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5d7a0935-1a35-48c9-b2b4-8864d30c7b8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5d7a0935-1a35-48c9-b2b4-8864d30c7b8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-5d7a0935-1a35-48c9-b2b4-8864d30c7b8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7dcfe84c23f4c0aa80b8f287f0ab004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631ee1e131e94577b853a5ae0886a318', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:28:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-5d7a0935-1a35-48c9-b2b4-8864d30c7b8a tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210" status: 200 len: 1565 microversion: 2.1 time: 0.203069 Apr 11 17:28:10 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 357/1074] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:28:10 2023] GET /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210 => generated 1565 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:28:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:10 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell0:SELECT=6 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:10 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f054c2a-84ad-48a6-ad76-8aaf5038c210", "name": "network-vif-unplugged", "status": "completed", "tag": "56ae4ea0-6935-4111-9767-36f6e5d04d93"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:28:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:10 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] Creating event network-vif-unplugged:56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 on user Apr 11 17:28:10 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-6174ea55-b099-437f-a511-7a02493be972 req-e6db2a09-0607-4ea0-9c0e-7dc8c00b6993 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047950 Apr 11 17:28:10 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 358/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:28:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:28:10 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:10 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:10 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:10 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:28:10 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c8413ee8-5bac-4940-91a0-706914f2f281 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53" status: 204 len: 0 microversion: 2.1 time: 0.251048 Apr 11 17:28:10 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 361/1076] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:28:10 2023] DELETE /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-24583d30-148a-457d-9f49-a90d19728a05 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-24583d30-148a-457d-9f49-a90d19728a05 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-24583d30-148a-457d-9f49-a90d19728a05 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-24583d30-148a-457d-9f49-a90d19728a05 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-24583d30-148a-457d-9f49-a90d19728a05 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-24583d30-148a-457d-9f49-a90d19728a05 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-24583d30-148a-457d-9f49-a90d19728a05 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-24583d30-148a-457d-9f49-a90d19728a05 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:11 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-24583d30-148a-457d-9f49-a90d19728a05 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eed61e2d73a84d85a9f5ff2b314624c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab7ce3fc251f4f1eb9151d1ef8c86d91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:28:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-24583d30-148a-457d-9f49-a90d19728a05 tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53" status: 200 len: 1544 microversion: 2.1 time: 0.222871 Apr 11 17:28:11 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 358/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:28:10 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 => generated 1544 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:28:11 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "name": "network-vif-unplugged", "status": "completed", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:28:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:11 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] Creating event network-vif-unplugged:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:28:11 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-cdb0ceb0-8865-42c8-9f5f-60acc0e49158 req-bcb52157-caf3-4300-af20-53a88f7303ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046741 Apr 11 17:28:11 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 359/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:28:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:28:12 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-b36c8d94-c1a2-4c83-b5ea-3af233742f0d req-b5eb04a1-24c9-44eb-850f-ec12a3854933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "name": "network-vif-deleted", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:28:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b36c8d94-c1a2-4c83-b5ea-3af233742f0d req-b5eb04a1-24c9-44eb-850f-ec12a3854933 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b36c8d94-c1a2-4c83-b5ea-3af233742f0d req-b5eb04a1-24c9-44eb-850f-ec12a3854933 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:12 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b36c8d94-c1a2-4c83-b5ea-3af233742f0d req-b5eb04a1-24c9-44eb-850f-ec12a3854933 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-b36c8d94-c1a2-4c83-b5ea-3af233742f0d req-b5eb04a1-24c9-44eb-850f-ec12a3854933 service nova] Creating event network-vif-deleted:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:28:12 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-b36c8d94-c1a2-4c83-b5ea-3af233742f0d req-b5eb04a1-24c9-44eb-850f-ec12a3854933 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075427 Apr 11 17:28:12 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 362/1079] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:28:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:28:12 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f054c2a-84ad-48a6-ad76-8aaf5038c210", "name": "network-vif-plugged", "status": "completed", "tag": "56ae4ea0-6935-4111-9767-36f6e5d04d93"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:28:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:12 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] Creating event network-vif-plugged:56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 on user Apr 11 17:28:12 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-ca2a904f-eb0f-4439-8f8a-7e054ec769ce req-2dfddc32-0315-44b7-9f01-223c8c6a9341 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046044 Apr 11 17:28:12 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 359/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:28:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:28:13 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2cc7a5-a96b-426e-852c-39b011fe2a53", "name": "network-vif-plugged", "status": "completed", "tag": "9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638"}, {"server_uuid": "1f054c2a-84ad-48a6-ad76-8aaf5038c210", "name": "network-vif-deleted", "tag": "56ae4ea0-6935-4111-9767-36f6e5d04d93"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:28:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:13 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:13 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] Creating event network-vif-plugged:9e38f2a1-ddac-4eae-8bc3-dc5d2b5b3638 for instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 on user Apr 11 17:28:13 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] Creating event network-vif-deleted:56ae4ea0-6935-4111-9767-36f6e5d04d93 for instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 on user Apr 11 17:28:13 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-ff87ecdf-5fa8-477c-b010-1b7cc1a34d89 req-4c0a221e-9a6e-429b-9e0a-e206dfeeaeff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031353 Apr 11 17:28:13 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 360/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:28:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:28:22 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:22 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-2e3436be-9981-46e7-be5a-f81bed603be4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:22 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-2e3436be-9981-46e7-be5a-f81bed603be4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2e3436be-9981-46e7-be5a-f81bed603be4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2e3436be-9981-46e7-be5a-f81bed603be4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2e3436be-9981-46e7-be5a-f81bed603be4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2e3436be-9981-46e7-be5a-f81bed603be4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2e3436be-9981-46e7-be5a-f81bed603be4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:22 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-2e3436be-9981-46e7-be5a-f81bed603be4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:22 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-2e3436be-9981-46e7-be5a-f81bed603be4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:28:22 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-2e3436be-9981-46e7-be5a-f81bed603be4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730" status: 200 len: 1545 microversion: 2.1 time: 0.483101 Apr 11 17:28:22 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 363/1082] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:28:22 2023] GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730 => generated 1545 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=14 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=22 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] HTTP exception thrown: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Request method failure captured: Apr 11 17:28:25 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 HTTP/1.1 Apr 11 17:28:25 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:28:25 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:28:25 user devstack@n-api.service[61422]: Connection: close Apr 11 17:28:25 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:28:25 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:28:25 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:28:25 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:28:25 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZV6qdu8jsEV9INPt_i9pG5yjipeDWfyeQO51QRwL4Wn4mv6yT9fgJwwoAxERgaM-XKCmNZB_y1Py-t0kZfRKSvoWg_hcVZtRBwvIE561lWxMwF_cDLTlaVX9m1WMlc4Q_n9gnsxLZIXYwHCQ9cU02V_lZW2Z0PM9MJsOoxxte4yzDk Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Project-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fce268052b8046e5a7efa41048e96645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}] Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Tenant-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:28:25 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:25 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:28:25 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:28:25 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:28:25 user devstack@n-api.service[61422]: X-User-Id: b69069a1461d485598e2078cc12772a5 Apr 11 17:28:25 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:28:25 user devstack@n-api.service[61422]: method: > Apr 11 17:28:25 user devstack@n-api.service[61422]: exception: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:25 user devstack@n-api.service[61422]: action_args: {'id': 'e5c59a1a-121c-41c4-8ca4-b6675b5191c8'} Apr 11 17:28:25 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Returning 404 to user: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:28:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-f7abcab4-3f08-48e9-a588-54ac6854d367 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8" status: 404 len: 111 microversion: 2.20 time: 0.035871 Apr 11 17:28:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 360/1083] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:28:25 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:28:25 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:25 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=18 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:25 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ff76ba77-f80a-42d1-a0af-d19b3da8fda9 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '.version_select at 0x7f5bdd7d12d0>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:25 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ff76ba77-f80a-42d1-a0af-d19b3da8fda9 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845823024" status: 204 len: 0 microversion: 2.20 time: 0.027710 Apr 11 17:28:25 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 361/1084] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 17:28:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1845823024 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 17:28:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:26 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:26 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:26 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] HTTP exception thrown: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:26 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Request method failure captured: Apr 11 17:28:26 user devstack@n-api.service[61424]: request: DELETE /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 HTTP/1.1 Apr 11 17:28:26 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:28:26 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:28:26 user devstack@n-api.service[61424]: Connection: close Apr 11 17:28:26 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:28:26 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:28:26 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:28:26 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:28:26 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZV6qdu8jsEV9INPt_i9pG5yjipeDWfyeQO51QRwL4Wn4mv6yT9fgJwwoAxERgaM-XKCmNZB_y1Py-t0kZfRKSvoWg_hcVZtRBwvIE561lWxMwF_cDLTlaVX9m1WMlc4Q_n9gnsxLZIXYwHCQ9cU02V_lZW2Z0PM9MJsOoxxte4yzDk Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Project-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fce268052b8046e5a7efa41048e96645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}] Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Tenant-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:28:26 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:26 user devstack@n-api.service[61424]: X-User: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:28:26 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:28:26 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:28:26 user devstack@n-api.service[61424]: X-User-Id: b69069a1461d485598e2078cc12772a5 Apr 11 17:28:26 user devstack@n-api.service[61424]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:28:26 user devstack@n-api.service[61424]: method: > Apr 11 17:28:26 user devstack@n-api.service[61424]: exception: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:26 user devstack@n-api.service[61424]: action_args: {'id': 'e5c59a1a-121c-41c4-8ca4-b6675b5191c8'} Apr 11 17:28:26 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:26 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:28:27 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:27 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:28:27 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:27 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:28:27 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:28:27 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:28:27 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:28:27 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:27 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:28:27 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Returning 404 to user: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:28:27 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-59bb5146-ac96-4844-b8c6-a99a6ded6f86 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8" status: 404 len: 111 microversion: 2.20 time: 0.037469 Apr 11 17:28:27 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 364/1085] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:28:26 2023] DELETE /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:28:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:27 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: e5c59a1a-121c-41c4-8ca4-b6675b5191c8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:27 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] HTTP exception thrown: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Request method failure captured: Apr 11 17:28:27 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 HTTP/1.1 Apr 11 17:28:27 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:28:27 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:28:27 user devstack@n-api.service[61422]: Connection: close Apr 11 17:28:27 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:28:27 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:28:27 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:28:27 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:28:27 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZV6qdu8jsEV9INPt_i9pG5yjipeDWfyeQO51QRwL4Wn4mv6yT9fgJwwoAxERgaM-XKCmNZB_y1Py-t0kZfRKSvoWg_hcVZtRBwvIE561lWxMwF_cDLTlaVX9m1WMlc4Q_n9gnsxLZIXYwHCQ9cU02V_lZW2Z0PM9MJsOoxxte4yzDk Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Project-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fce268052b8046e5a7efa41048e96645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}] Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Tenant-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:28:27 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:27 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:28:27 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:28:27 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:28:27 user devstack@n-api.service[61422]: X-User-Id: b69069a1461d485598e2078cc12772a5 Apr 11 17:28:27 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:28:27 user devstack@n-api.service[61422]: method: > Apr 11 17:28:27 user devstack@n-api.service[61422]: exception: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:27 user devstack@n-api.service[61422]: action_args: {'id': 'e5c59a1a-121c-41c4-8ca4-b6675b5191c8'} Apr 11 17:28:27 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. Apr 11 17:28:27 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:28:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Returning 404 to user: Instance e5c59a1a-121c-41c4-8ca4-b6675b5191c8 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:28:27 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8171ae11-63d0-42a9-ad59-fa63672d809f tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8" status: 404 len: 111 microversion: 2.20 time: 0.034016 Apr 11 17:28:27 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 361/1086] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:28:27 2023] GET /compute/v2.1/servers/e5c59a1a-121c-41c4-8ca4-b6675b5191c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:28:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:28 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:28 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] HTTP exception thrown: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:28:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Request method failure captured: Apr 11 17:28:28 user devstack@n-api.service[61423]: request: DELETE /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 HTTP/1.1 Apr 11 17:28:28 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:28:28 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:28:28 user devstack@n-api.service[61423]: Connection: close Apr 11 17:28:28 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:28:28 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:28:28 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:28:28 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:28:28 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZV6qdu8jsEV9INPt_i9pG5yjipeDWfyeQO51QRwL4Wn4mv6yT9fgJwwoAxERgaM-XKCmNZB_y1Py-t0kZfRKSvoWg_hcVZtRBwvIE561lWxMwF_cDLTlaVX9m1WMlc4Q_n9gnsxLZIXYwHCQ9cU02V_lZW2Z0PM9MJsOoxxte4yzDk Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Project-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fce268052b8046e5a7efa41048e96645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}] Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Tenant-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:28:28 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:28 user devstack@n-api.service[61423]: X-User: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:28:28 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:28:28 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:28:28 user devstack@n-api.service[61423]: X-User-Id: b69069a1461d485598e2078cc12772a5 Apr 11 17:28:28 user devstack@n-api.service[61423]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:28:28 user devstack@n-api.service[61423]: method: > Apr 11 17:28:28 user devstack@n-api.service[61423]: exception: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:28:28 user devstack@n-api.service[61423]: action_args: {'id': '49e044ae-91af-4db8-b0fe-3679dd210ab2'} Apr 11 17:28:28 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:28:28 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:28:28 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Returning 404 to user: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:28:28 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e35eff88-e61f-443a-860a-5de115704040 tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2" status: 404 len: 111 microversion: 2.20 time: 0.049894 Apr 11 17:28:28 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 362/1087] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 17:28:28 2023] DELETE /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:28:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:28 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] [instance: 49e044ae-91af-4db8-b0fe-3679dd210ab2] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] HTTP exception thrown: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:28:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Request method failure captured: Apr 11 17:28:28 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 HTTP/1.1 Apr 11 17:28:28 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:28:28 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:28:28 user devstack@n-api.service[61424]: Connection: close Apr 11 17:28:28 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:28:28 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:28:28 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:28:28 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:28:28 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZV6qdu8jsEV9INPt_i9pG5yjipeDWfyeQO51QRwL4Wn4mv6yT9fgJwwoAxERgaM-XKCmNZB_y1Py-t0kZfRKSvoWg_hcVZtRBwvIE561lWxMwF_cDLTlaVX9m1WMlc4Q_n9gnsxLZIXYwHCQ9cU02V_lZW2Z0PM9MJsOoxxte4yzDk Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Project-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fce268052b8046e5a7efa41048e96645"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fce268052b8046e5a7efa41048e96645"}]}] Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Tenant-Id: fce268052b8046e5a7efa41048e96645 Apr 11 17:28:28 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051096798 Apr 11 17:28:28 user devstack@n-api.service[61424]: X-User: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:28:28 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:28:28 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:28:28 user devstack@n-api.service[61424]: X-User-Id: b69069a1461d485598e2078cc12772a5 Apr 11 17:28:28 user devstack@n-api.service[61424]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051096798-project-member Apr 11 17:28:28 user devstack@n-api.service[61424]: method: > Apr 11 17:28:28 user devstack@n-api.service[61424]: exception: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:28:28 user devstack@n-api.service[61424]: action_args: {'id': '49e044ae-91af-4db8-b0fe-3679dd210ab2'} Apr 11 17:28:28 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. Apr 11 17:28:28 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:28:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] Returning 404 to user: Instance 49e044ae-91af-4db8-b0fe-3679dd210ab2 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:28:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-cb77fcb7-d451-4808-a135-5c0c3460955b tempest-AttachVolumeShelveTestJSON-2051096798 tempest-AttachVolumeShelveTestJSON-2051096798-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2" status: 404 len: 111 microversion: 2.20 time: 0.032283 Apr 11 17:28:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 365/1088] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 17:28:28 2023] GET /compute/v2.1/servers/49e044ae-91af-4db8-b0fe-3679dd210ab2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 17:28:50 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-736e328b-93fa-43e8-80cd-4c80fd3833a0 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:28:50 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-736e328b-93fa-43e8-80cd-4c80fd3833a0 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:28:50 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:50 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:28:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-736e328b-93fa-43e8-80cd-4c80fd3833a0 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-736e328b-93fa-43e8-80cd-4c80fd3833a0 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-736e328b-93fa-43e8-80cd-4c80fd3833a0 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-736e328b-93fa-43e8-80cd-4c80fd3833a0 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:28:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-736e328b-93fa-43e8-80cd-4c80fd3833a0 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:28:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-736e328b-93fa-43e8-80cd-4c80fd3833a0 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:28:50 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-736e328b-93fa-43e8-80cd-4c80fd3833a0 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9c28bb4f84dc7bb865446203e54eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8aed1a07fb4244ad9ec8c8d9816a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:28:50 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-736e328b-93fa-43e8-80cd-4c80fd3833a0 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bee1911-3859-4292-8bc5-4572963aa007" status: 200 len: 1454 microversion: 2.1 time: 0.298532 Apr 11 17:28:50 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 362/1089] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:28:50 2023] GET /compute/v2.1/servers/8bee1911-3859-4292-8bc5-4572963aa007 => generated 1454 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 1f054c2a-84ad-48a6-ad76-8aaf5038c210] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 could not be found. Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:29:00 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210 HTTP/1.1 Apr 11 17:29:00 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:29:00 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:29:00 user devstack@n-api.service[61423]: Connection: close Apr 11 17:29:00 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:29:00 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:29:00 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:29:00 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:29:00 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:29:00 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:29:00 user devstack@n-api.service[61423]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:29:00 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:29:00 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:29:00 user devstack@n-api.service[61423]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:29:00 user devstack@n-api.service[61423]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:29:00 user devstack@n-api.service[61423]: method: > Apr 11 17:29:00 user devstack@n-api.service[61423]: exception: Instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 could not be found. Apr 11 17:29:00 user devstack@n-api.service[61423]: action_args: {'id': '1f054c2a-84ad-48a6-ad76-8aaf5038c210'} Apr 11 17:29:00 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 could not be found. Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 could not be found. Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 could not be found. Apr 11 17:29:00 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:29:00 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance 1f054c2a-84ad-48a6-ad76-8aaf5038c210 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:29:00 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-66603e1a-026f-4970-aad5-da7bcd241aa6 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210" status: 404 len: 111 microversion: 2.1 time: 0.186794 Apr 11 17:29:00 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 363/1090] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:29:00 2023] GET /compute/v2.1/servers/1f054c2a-84ad-48a6-ad76-8aaf5038c210 => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] [instance: 7b2cc7a5-a96b-426e-852c-39b011fe2a53] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] HTTP exception thrown: Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Request method failure captured: Apr 11 17:29:01 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 HTTP/1.1 Apr 11 17:29:01 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:29:01 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:29:01 user devstack@n-api.service[61424]: Connection: close Apr 11 17:29:01 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:29:01 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:29:01 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:29:01 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:29:01 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZYlhmC2oiI6gawAcJGuGfhGnknZ5_xndVlxiBUaQ3wKzuhK4fXibdfH7ZQS_-TN5Szk3SxPMXMnqqbwxxD6ZscmqYMTGl2T0NIK5iZcohVwGGZz6gaUn0krHMhPcd7SmQGQLJe-WjRRr2-_j2Cj8_lU7tYmQyPUfMvs40eq-Xle0Fs Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Project-Id: ab7ce3fc251f4f1eb9151d1ef8c86d91 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Project-Name: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab7ce3fc251f4f1eb9151d1ef8c86d91"}]}] Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Tenant: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Tenant-Id: ab7ce3fc251f4f1eb9151d1ef8c86d91 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-TestMinimumBasicScenario-593818068 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-User: tempest-TestMinimumBasicScenario-593818068-project-member Apr 11 17:29:01 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:29:01 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:29:01 user devstack@n-api.service[61424]: X-User-Id: eed61e2d73a84d85a9f5ff2b314624c9 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-User-Name: tempest-TestMinimumBasicScenario-593818068-project-member Apr 11 17:29:01 user devstack@n-api.service[61424]: method: > Apr 11 17:29:01 user devstack@n-api.service[61424]: exception: Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61424]: action_args: {'id': '7b2cc7a5-a96b-426e-852c-39b011fe2a53'} Apr 11 17:29:01 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Returning 404 to user: Instance 7b2cc7a5-a96b-426e-852c-39b011fe2a53 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:29:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-97d9def0-2350-4385-9541-223aa6598eac tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53" status: 404 len: 111 microversion: 2.1 time: 0.171269 Apr 11 17:29:01 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 366/1091] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:29:01 2023] GET /compute/v2.1/servers/7b2cc7a5-a96b-426e-852c-39b011fe2a53 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:29:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3779a301-f840-41c5-9aae-eb081eefdb5d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] Calling method '.version_select at 0x7f5bddbd0f70>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:01 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:01 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3779a301-f840-41c5-9aae-eb081eefdb5d tempest-TestMinimumBasicScenario-593818068 tempest-TestMinimumBasicScenario-593818068-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1538973025" status: 202 len: 0 microversion: 2.1 time: 0.024822 Apr 11 17:29:01 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 363/1092] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 11 17:29:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1538973025 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:29:01 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:01 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:01 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:01 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:29:01 user devstack@n-api.service[61423]: request: DELETE /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 HTTP/1.1 Apr 11 17:29:01 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:29:01 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:29:01 user devstack@n-api.service[61423]: Connection: close Apr 11 17:29:01 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:29:01 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:29:01 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:29:01 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:29:01 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:29:01 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:29:01 user devstack@n-api.service[61423]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:29:01 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:29:01 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:29:01 user devstack@n-api.service[61423]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:29:01 user devstack@n-api.service[61423]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:29:01 user devstack@n-api.service[61423]: method: > Apr 11 17:29:01 user devstack@n-api.service[61423]: exception: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61423]: action_args: {'id': '4e53bfed-5cf9-47c1-ae70-63b89a7f8d47'} Apr 11 17:29:01 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:29:01 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-adf088d3-5270-428f-bf95-9e9f31067985 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" status: 404 len: 111 microversion: 2.1 time: 0.032299 Apr 11 17:29:01 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 364/1093] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:29:01 2023] DELETE /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] [instance: 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] HTTP exception thrown: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Request method failure captured: Apr 11 17:29:01 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 HTTP/1.1 Apr 11 17:29:01 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:29:01 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:29:01 user devstack@n-api.service[61424]: Connection: close Apr 11 17:29:01 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:29:01 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:29:01 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:29:01 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:29:01 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZTtzJ4tTVwgvQTqjppuD9QQu1XeNIbaWPJh8KsjeFAaeRgodpudHaQ4ibXbVFYSvJgYyssMFhbd9onwmY5aw6WZRtly1HqWO4nMCxwf3Dw6agcuhXU_DKsrbXzZ5wjADLRX_N8uUw0WKG6D7wYLzhcMJan8NigQ8ZZvXMo4WeRrCWg Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Project-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Project-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/631ee1e131e94577b853a5ae0886a318"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/631ee1e131e94577b853a5ae0886a318"}]}] Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Tenant: tempest-TestVolumeBootPattern-665298870 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Tenant-Id: 631ee1e131e94577b853a5ae0886a318 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-TestVolumeBootPattern-665298870 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-User: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:29:01 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:29:01 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:29:01 user devstack@n-api.service[61424]: X-User-Id: c7dcfe84c23f4c0aa80b8f287f0ab004 Apr 11 17:29:01 user devstack@n-api.service[61424]: X-User-Name: tempest-TestVolumeBootPattern-665298870-project-member Apr 11 17:29:01 user devstack@n-api.service[61424]: method: > Apr 11 17:29:01 user devstack@n-api.service[61424]: exception: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61424]: action_args: {'id': '4e53bfed-5cf9-47c1-ae70-63b89a7f8d47'} Apr 11 17:29:01 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. Apr 11 17:29:01 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:29:01 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Returning 404 to user: Instance 4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:29:01 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-cc7f2e5c-2a7a-4bd0-8678-09eb4e9bdbe4 tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47" status: 404 len: 111 microversion: 2.1 time: 0.100920 Apr 11 17:29:01 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 367/1094] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:29:01 2023] GET /compute/v2.1/servers/4e53bfed-5cf9-47c1-ae70-63b89a7f8d47 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:29:03 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5db1489f-25e3-474b-bc17-10325123995e tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] Calling method '.version_select at 0x7f5bdd929d80>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:03 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-5db1489f-25e3-474b-bc17-10325123995e tempest-TestVolumeBootPattern-665298870 tempest-TestVolumeBootPattern-665298870-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-967443343" status: 202 len: 0 microversion: 2.1 time: 0.024625 Apr 11 17:29:03 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 364/1095] 10.0.0.210 () {62 vars in 1337 bytes} [Tue Apr 11 17:29:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-967443343 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:29:22 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2d647eff-05e7-4d2c-a876-8596c2f582f1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:22 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2d647eff-05e7-4d2c-a876-8596c2f582f1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:22 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:22 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d647eff-05e7-4d2c-a876-8596c2f582f1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d647eff-05e7-4d2c-a876-8596c2f582f1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d647eff-05e7-4d2c-a876-8596c2f582f1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d647eff-05e7-4d2c-a876-8596c2f582f1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d647eff-05e7-4d2c-a876-8596c2f582f1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:22 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2d647eff-05e7-4d2c-a876-8596c2f582f1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:22 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2d647eff-05e7-4d2c-a876-8596c2f582f1 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.339658 Apr 11 17:29:22 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 365/1096] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:29:22 2023] GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/os-interface => generated 283 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:29:23 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d149c96-1eca-4e4c-8165-e56fcfb1f730", "tag": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:29:23 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=4 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:23 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=4 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:23 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] Creating event network-changed:2b3a5d7c-36dd-4752-81ff-b52dd20899e1 for instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 on user Apr 11 17:29:23 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-d137eb4e-142c-4b0c-a378-dfec2e768c2f req-54ce5101-fcf4-4179-a04a-30069f8e5735 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055542 Apr 11 17:29:23 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 368/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:29:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:29:23 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3f07a4ba-a4f5-47f2-8184-0449a4c39983 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:23 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-3f07a4ba-a4f5-47f2-8184-0449a4c39983 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:23 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3f07a4ba-a4f5-47f2-8184-0449a4c39983 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3f07a4ba-a4f5-47f2-8184-0449a4c39983 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3f07a4ba-a4f5-47f2-8184-0449a4c39983 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3f07a4ba-a4f5-47f2-8184-0449a4c39983 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3f07a4ba-a4f5-47f2-8184-0449a4c39983 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3f07a4ba-a4f5-47f2-8184-0449a4c39983 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:23 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3f07a4ba-a4f5-47f2-8184-0449a4c39983 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/ips" status: 200 len: 109 microversion: 2.1 time: 0.043054 Apr 11 17:29:23 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 365/1098] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 17:29:23 2023] GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/ips => generated 109 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:29:25 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79fb9a22-498c-4c30-bd46-567c0cac048b"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:29:25 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:25 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-27970a68-cabc-4a8c-82bf-bdb6f0ffb07e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332845 Apr 11 17:29:25 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 366/1099] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:29:25 2023] POST /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:29:33 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-ee0a0a2f-7b65-4a19-98a0-9292fad50bc8 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Action: 'create', calling method: .version_select at 0x7f5bdd8e2d40>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-338437608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLQB3hCozlMMIqp8odpehHgtCJL4HcFmbQmLQu5HQlMQXnbcjyZoiXHRa9f7JpNIEhGsNHAJKfdN63Ok9Y6vO6N1/4XwAxq8u/TNPBG1hi9iuATK5K8CEbAJxT4JLAjPg=="}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:29:33 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-ee0a0a2f-7b65-4a19-98a0-9292fad50bc8 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Getting quotas for project 9352d5bd04c5433c8233473a0a5a9cfe. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:29:33 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-ee0a0a2f-7b65-4a19-98a0-9292fad50bc8 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Getting quotas for user 54f53effabdb4b80aec41b67f3bad208 and project 9352d5bd04c5433c8233473a0a5a9cfe. Resources: {'key_pairs'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:29:33 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-ee0a0a2f-7b65-4a19-98a0-9292fad50bc8 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.225434 Apr 11 17:29:33 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 369/1100] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 17:29:32 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:29:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:33 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:33 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lazy-loading 'services' on Instance uuid 4d149c96-1eca-4e4c-8165-e56fcfb1f730 {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:29:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-a83d9850-6e32-40d6-8e69-535cd20c8de2 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/os-volume_attachments/79fb9a22-498c-4c30-bd46-567c0cac048b" status: 202 len: 0 microversion: 2.1 time: 0.162641 Apr 11 17:29:33 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 366/1101] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:29:33 2023] DELETE /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/os-volume_attachments/79fb9a22-498c-4c30-bd46-567c0cac048b => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:29:33 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-410151c6-c671-4753-b24e-f425c6afdf48 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:33 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-410151c6-c671-4753-b24e-f425c6afdf48 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-410151c6-c671-4753-b24e-f425c6afdf48 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-410151c6-c671-4753-b24e-f425c6afdf48 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-410151c6-c671-4753-b24e-f425c6afdf48 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-410151c6-c671-4753-b24e-f425c6afdf48 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-410151c6-c671-4753-b24e-f425c6afdf48 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:33 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-410151c6-c671-4753-b24e-f425c6afdf48 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:33 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-410151c6-c671-4753-b24e-f425c6afdf48 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054192 Apr 11 17:29:33 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 367/1102] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:29:33 2023] GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:29:34 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1485109156", "imageRef": "ead60aec-ecbe-42c9-a205-fb6fdd4aef73", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-338437608", "security_groups": [{"name": "tempest-secgroup-smoke-2062731947"}], "networks": [{"uuid": "231e0b88-2a84-41ce-ab60-81d7abe6161b"}]}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:29:34 user devstack@n-api.service[61424]: DEBUG nova.network.neutron [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] validate_networks() for [('231e0b88-2a84-41ce-ab60-81d7abe6161b', None, None, None, None, None)] {{(pid=61424) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Flavor limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Image limits 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Flavor pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Image pref 0:0:0 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG nova.virt.hardware [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61424) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Getting quotas for project 9352d5bd04c5433c8233473a0a5a9cfe. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG nova.quota [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Getting quotas for user 54f53effabdb4b80aec41b67f3bad208 and project 9352d5bd04c5433c8233473a0a5a9cfe. Resources: {'cores', 'instances', 'ram'} {{(pid=61424) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Going to run 1 instances... {{(pid=61424) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 17:29:35 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ead60aec-ecbe-42c9-a205-fb6fdd4aef73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61424) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 17:29:35 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-e8f8ca99-b048-4b2d-a695-29e50bfde2f9 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.693960 Apr 11 17:29:35 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 370/1103] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 17:29:34 2023] POST /compute/v2.1/servers => generated 404 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 17:29:35 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-62c57619-16b2-4fe4-859e-008032f1dbde tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:35 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-62c57619-16b2-4fe4-859e-008032f1dbde tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:35 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-62c57619-16b2-4fe4-859e-008032f1dbde tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f53effabdb4b80aec41b67f3bad208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9352d5bd04c5433c8233473a0a5a9cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:29:35 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-62c57619-16b2-4fe4-859e-008032f1dbde tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b" status: 200 len: 1256 microversion: 2.1 time: 0.066416 Apr 11 17:29:35 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 367/1104] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:29:35 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b => generated 1256 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:29:37 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259f5df3-9c93-4e5e-82cc-5c350632534b", "tag": "363c768e-4cdf-4715-98c4-1bfce1e81e49"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:29:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:37 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] Creating event network-changed:363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b on user Apr 11 17:29:37 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-da6fe83c-a842-4785-9a92-c7991561d773 req-c590edc8-2fd3-4522-ae19-33c701266228 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087827 Apr 11 17:29:37 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 368/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:29:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:29:39 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259f5df3-9c93-4e5e-82cc-5c350632534b", "name": "network-vif-plugged", "status": "completed", "tag": "363c768e-4cdf-4715-98c4-1bfce1e81e49"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:29:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] Creating event network-vif-plugged:363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b on user Apr 11 17:29:39 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-88e4fd0e-d9b6-4874-b642-0e061da0bf3a req-3843a720-c83d-458a-a800-ff5c46d4e0cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033550 Apr 11 17:29:39 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 371/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:29:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:29:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259f5df3-9c93-4e5e-82cc-5c350632534b", "name": "network-vif-plugged", "status": "completed", "tag": "363c768e-4cdf-4715-98c4-1bfce1e81e49"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:29:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] Creating event network-vif-plugged:363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b on user Apr 11 17:29:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-2e4b35cd-86a9-41f2-b13d-1c23c5ac1bf2 req-9d1d8b09-7936-4057-98c0-bec74f999d18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040875 Apr 11 17:29:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 368/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:29:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:29:50 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:50 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:50 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:50 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:50 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:51 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Going to try to terminate instance {{(pid=61423) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:29:51 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ff29b335-7005-4d38-bcb8-473ccc2ee2bf tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8bee1911-3859-4292-8bc5-4572963aa007" status: 204 len: 0 microversion: 2.1 time: 0.125736 Apr 11 17:29:51 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 369/1108] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:29:50 2023] DELETE /compute/v2.1/servers/8bee1911-3859-4292-8bc5-4572963aa007 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell0:SELECT=10 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=4 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-9b8f5ce2-e13b-4aed-b224-6a8b325e3335 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-9b8f5ce2-e13b-4aed-b224-6a8b325e3335 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9b8f5ce2-e13b-4aed-b224-6a8b325e3335 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9b8f5ce2-e13b-4aed-b224-6a8b325e3335 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9b8f5ce2-e13b-4aed-b224-6a8b325e3335 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9b8f5ce2-e13b-4aed-b224-6a8b325e3335 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9b8f5ce2-e13b-4aed-b224-6a8b325e3335 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-9b8f5ce2-e13b-4aed-b224-6a8b325e3335 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:51 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bee1911-3859-4292-8bc5-4572963aa007", "name": "network-vif-unplugged", "status": "completed", "tag": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:29:51 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:29:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:51 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] Creating event network-vif-unplugged:c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 for instance 8bee1911-3859-4292-8bc5-4572963aa007 on user Apr 11 17:29:51 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-355600bd-7472-440f-b830-91ef187bf711 req-fbbd20cd-0cb5-4ce6-a44e-0622b791fa1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053363 Apr 11 17:29:51 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 369/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:29:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:29:51 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-9b8f5ce2-e13b-4aed-b224-6a8b325e3335 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9c28bb4f84dc7bb865446203e54eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f8aed1a07fb4244ad9ec8c8d9816a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:29:51 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-9b8f5ce2-e13b-4aed-b224-6a8b325e3335 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bee1911-3859-4292-8bc5-4572963aa007" status: 200 len: 1460 microversion: 2.1 time: 0.478122 Apr 11 17:29:51 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 372/1110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:29:51 2023] GET /compute/v2.1/servers/8bee1911-3859-4292-8bc5-4572963aa007 => generated 1460 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:29:53 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bee1911-3859-4292-8bc5-4572963aa007", "name": "network-vif-plugged", "status": "completed", "tag": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1"}, {"server_uuid": "8bee1911-3859-4292-8bc5-4572963aa007", "name": "network-vif-deleted", "tag": "c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:29:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:29:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:29:53 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:29:53 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] Creating event network-vif-plugged:c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 for instance 8bee1911-3859-4292-8bc5-4572963aa007 on user Apr 11 17:29:53 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] Creating event network-vif-deleted:c32a4b0d-6dfe-49b8-9f58-ce3ca7b011c1 for instance 8bee1911-3859-4292-8bc5-4572963aa007 on user Apr 11 17:29:53 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-5ce28af6-2fa5-44e9-9fb2-81d939d49e8b req-2d845a9e-77f4-48f3-aabf-c26b3355b9ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033876 Apr 11 17:29:53 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 370/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:30:23 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=12 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:30:23 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:30:23 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-0ee0dd2a-9fae-4093-83eb-fb46e09f706c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:30:23 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-0ee0dd2a-9fae-4093-83eb-fb46e09f706c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:30:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ee0dd2a-9fae-4093-83eb-fb46e09f706c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ee0dd2a-9fae-4093-83eb-fb46e09f706c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ee0dd2a-9fae-4093-83eb-fb46e09f706c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ee0dd2a-9fae-4093-83eb-fb46e09f706c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ee0dd2a-9fae-4093-83eb-fb46e09f706c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ee0dd2a-9fae-4093-83eb-fb46e09f706c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:23 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-0ee0dd2a-9fae-4093-83eb-fb46e09f706c tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051407 Apr 11 17:30:23 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 370/1112] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:30:23 2023] GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:30:23 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:30:23 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:30:23 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:30:23 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:30:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:23 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:23 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:30:23 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-177471ae-8330-4f2d-8ea6-40329670d611 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730" status: 204 len: 0 microversion: 2.1 time: 0.142177 Apr 11 17:30:23 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 373/1113] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:30:23 2023] DELETE /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:30:23 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:30:23 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:30:23 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-123cb06c-63c5-4f30-8e4b-b335fa5c52bc tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:30:23 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-123cb06c-63c5-4f30-8e4b-b335fa5c52bc tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:30:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-123cb06c-63c5-4f30-8e4b-b335fa5c52bc tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-123cb06c-63c5-4f30-8e4b-b335fa5c52bc tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-123cb06c-63c5-4f30-8e4b-b335fa5c52bc tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-123cb06c-63c5-4f30-8e4b-b335fa5c52bc tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-123cb06c-63c5-4f30-8e4b-b335fa5c52bc tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:23 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-123cb06c-63c5-4f30-8e4b-b335fa5c52bc tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:24 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-123cb06c-63c5-4f30-8e4b-b335fa5c52bc tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff27d08254f74491aba3386c9b901300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c663a759724bbda32f189ceedf6675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:30:24 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-123cb06c-63c5-4f30-8e4b-b335fa5c52bc tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730" status: 200 len: 1669 microversion: 2.1 time: 0.233909 Apr 11 17:30:24 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 371/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:30:23 2023] GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730 => generated 1669 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:30:24 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d149c96-1eca-4e4c-8165-e56fcfb1f730", "name": "network-vif-unplugged", "status": "completed", "tag": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:30:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:24 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] Creating event network-vif-unplugged:2b3a5d7c-36dd-4752-81ff-b52dd20899e1 for instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 on user Apr 11 17:30:24 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-68d04a4f-0e3f-4c1f-b41d-fca73ee1b154 req-56471947-76a2-4325-a92e-c2cb34f1b854 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098802 Apr 11 17:30:24 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 371/1115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:30:25 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-87ad5cd8-5569-49ca-9e55-c49973415b2e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:30:25 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-87ad5cd8-5569-49ca-9e55-c49973415b2e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:30:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-87ad5cd8-5569-49ca-9e55-c49973415b2e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-87ad5cd8-5569-49ca-9e55-c49973415b2e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-87ad5cd8-5569-49ca-9e55-c49973415b2e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-87ad5cd8-5569-49ca-9e55-c49973415b2e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-87ad5cd8-5569-49ca-9e55-c49973415b2e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:25 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-87ad5cd8-5569-49ca-9e55-c49973415b2e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:25 user devstack@n-api.service[61424]: DEBUG nova.policy [None req-87ad5cd8-5569-49ca-9e55-c49973415b2e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f53effabdb4b80aec41b67f3bad208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9352d5bd04c5433c8233473a0a5a9cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61424) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:30:25 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-87ad5cd8-5569-49ca-9e55-c49973415b2e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b" status: 200 len: 1568 microversion: 2.1 time: 0.160525 Apr 11 17:30:25 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 374/1116] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:30:25 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:30:25 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [req-1e56308e-7831-4d06-9289-b01a593c2e02 req-20038a02-38b5-4006-8a90-675254358cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d149c96-1eca-4e4c-8165-e56fcfb1f730", "name": "network-vif-deleted", "tag": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1"}]} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:30:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1e56308e-7831-4d06-9289-b01a593c2e02 req-20038a02-38b5-4006-8a90-675254358cf4 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1e56308e-7831-4d06-9289-b01a593c2e02 req-20038a02-38b5-4006-8a90-675254358cf4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:25 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [req-1e56308e-7831-4d06-9289-b01a593c2e02 req-20038a02-38b5-4006-8a90-675254358cf4 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:25 user devstack@n-api.service[61423]: INFO nova.api.openstack.compute.server_external_events [req-1e56308e-7831-4d06-9289-b01a593c2e02 req-20038a02-38b5-4006-8a90-675254358cf4 service nova] Creating event network-vif-deleted:2b3a5d7c-36dd-4752-81ff-b52dd20899e1 for instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 on user Apr 11 17:30:25 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [req-1e56308e-7831-4d06-9289-b01a593c2e02 req-20038a02-38b5-4006-8a90-675254358cf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033083 Apr 11 17:30:25 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 372/1117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:30:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:30:26 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d149c96-1eca-4e4c-8165-e56fcfb1f730", "name": "network-vif-plugged", "status": "completed", "tag": "2b3a5d7c-36dd-4752-81ff-b52dd20899e1"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:30:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] Creating event network-vif-plugged:2b3a5d7c-36dd-4752-81ff-b52dd20899e1 for instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 on user Apr 11 17:30:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-3c8719a8-be89-4251-91c9-81f96edb62c8 req-29ad9c16-b6ac-462f-b3f1-461f886f637f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032452 Apr 11 17:30:26 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 372/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] [instance: 8bee1911-3859-4292-8bc5-4572963aa007] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:30:41 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] HTTP exception thrown: Instance 8bee1911-3859-4292-8bc5-4572963aa007 could not be found. Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Request method failure captured: Apr 11 17:30:41 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/8bee1911-3859-4292-8bc5-4572963aa007 HTTP/1.1 Apr 11 17:30:41 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:30:41 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:30:41 user devstack@n-api.service[61424]: Connection: close Apr 11 17:30:41 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:30:41 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:30:41 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:30:41 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:30:41 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZieN2d6BwdHqw5rfhynftKjmWU9DSchX6QoqJXRwFK74kBwCgHH7qpWw0V-ZHl7mrKeJ8mHMK15lQgFPFqrP70NaxwL6TN7WPPAOw21mfyRgqBIZxGMOb_J0qsCeLVg8XdZNgAoqoENjMFoLSTqk3XqxaKpBAUIpLZn5_a0KJv_Y20 Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Project-Id: 0f8aed1a07fb4244ad9ec8c8d9816a27 Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Project-Name: tempest-VolumesNegativeTest-2079915658 Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f8aed1a07fb4244ad9ec8c8d9816a27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0f8aed1a07fb4244ad9ec8c8d9816a27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0f8aed1a07fb4244ad9ec8c8d9816a27"}]}] Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Tenant: tempest-VolumesNegativeTest-2079915658 Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Tenant-Id: 0f8aed1a07fb4244ad9ec8c8d9816a27 Apr 11 17:30:41 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-VolumesNegativeTest-2079915658 Apr 11 17:30:41 user devstack@n-api.service[61424]: X-User: tempest-VolumesNegativeTest-2079915658-project-member Apr 11 17:30:41 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:30:41 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:30:41 user devstack@n-api.service[61424]: X-User-Id: cde9c28bb4f84dc7bb865446203e54eb Apr 11 17:30:41 user devstack@n-api.service[61424]: X-User-Name: tempest-VolumesNegativeTest-2079915658-project-member Apr 11 17:30:41 user devstack@n-api.service[61424]: method: > Apr 11 17:30:41 user devstack@n-api.service[61424]: exception: Instance 8bee1911-3859-4292-8bc5-4572963aa007 could not be found. Apr 11 17:30:41 user devstack@n-api.service[61424]: action_args: {'id': '8bee1911-3859-4292-8bc5-4572963aa007'} Apr 11 17:30:41 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bee1911-3859-4292-8bc5-4572963aa007 could not be found. Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bee1911-3859-4292-8bc5-4572963aa007 could not be found. Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bee1911-3859-4292-8bc5-4572963aa007 could not be found. Apr 11 17:30:41 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:30:41 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] Returning 404 to user: Instance 8bee1911-3859-4292-8bc5-4572963aa007 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:30:41 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-19949415-7d32-44dd-99b3-b8e6e3701ee2 tempest-VolumesNegativeTest-2079915658 tempest-VolumesNegativeTest-2079915658-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8bee1911-3859-4292-8bc5-4572963aa007" status: 404 len: 111 microversion: 2.1 time: 0.037421 Apr 11 17:30:41 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 375/1119] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:30:41 2023] GET /compute/v2.1/servers/8bee1911-3859-4292-8bc5-4572963aa007 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:14 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:31:14 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730 HTTP/1.1 Apr 11 17:31:14 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:31:14 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:31:14 user devstack@n-api.service[61423]: Connection: close Apr 11 17:31:14 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:31:14 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:31:14 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:31:14 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:31:14 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:14 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:14 user devstack@n-api.service[61423]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:14 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:31:14 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:31:14 user devstack@n-api.service[61423]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:31:14 user devstack@n-api.service[61423]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:14 user devstack@n-api.service[61423]: method: > Apr 11 17:31:14 user devstack@n-api.service[61423]: exception: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:14 user devstack@n-api.service[61423]: action_args: {'id': '4d149c96-1eca-4e4c-8165-e56fcfb1f730'} Apr 11 17:31:14 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:14 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:14 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:31:14 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2caac9bc-a479-4317-899a-d50f1b889e26 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730" status: 404 len: 111 microversion: 2.1 time: 0.037777 Apr 11 17:31:14 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 373/1120] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:31:14 2023] GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:31:14 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:14 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=10 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:14 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7b53e2a4-de73-4486-911c-848e4678a934 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '.version_select at 0x7f5bdd733a30>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:14 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7b53e2a4-de73-4486-911c-848e4678a934 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-50229463" status: 202 len: 0 microversion: 2.1 time: 0.029002 Apr 11 17:31:14 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 373/1121] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 11 17:31:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-50229463 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:31:15 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:15 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:15 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:15 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:15 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:15 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:15 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:15 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:15 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:15 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:31:16 user devstack@n-api.service[61424]: request: DELETE /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730 HTTP/1.1 Apr 11 17:31:16 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:31:16 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:31:16 user devstack@n-api.service[61424]: Connection: close Apr 11 17:31:16 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:31:16 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:31:16 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:31:16 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:31:16 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:16 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:16 user devstack@n-api.service[61424]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:16 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:31:16 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:31:16 user devstack@n-api.service[61424]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:31:16 user devstack@n-api.service[61424]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:16 user devstack@n-api.service[61424]: method: > Apr 11 17:31:16 user devstack@n-api.service[61424]: exception: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:16 user devstack@n-api.service[61424]: action_args: {'id': '4d149c96-1eca-4e4c-8165-e56fcfb1f730'} Apr 11 17:31:16 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:16 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:16 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:31:16 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-632eba0b-45f5-44cc-b9ac-588289f5df12 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730" status: 404 len: 111 microversion: 2.1 time: 0.044603 Apr 11 17:31:16 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 376/1122] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:31:15 2023] DELETE /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:31:16 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:16 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 4d149c96-1eca-4e4c-8165-e56fcfb1f730] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:16 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:16 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:16 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:31:16 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730 HTTP/1.1 Apr 11 17:31:16 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:31:16 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:31:16 user devstack@n-api.service[61423]: Connection: close Apr 11 17:31:16 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:31:16 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:31:16 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:31:16 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:31:16 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:16 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:16 user devstack@n-api.service[61423]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:16 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:31:16 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:31:16 user devstack@n-api.service[61423]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:31:16 user devstack@n-api.service[61423]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:16 user devstack@n-api.service[61423]: method: > Apr 11 17:31:16 user devstack@n-api.service[61423]: exception: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:16 user devstack@n-api.service[61423]: action_args: {'id': '4d149c96-1eca-4e4c-8165-e56fcfb1f730'} Apr 11 17:31:16 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. Apr 11 17:31:16 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:16 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance 4d149c96-1eca-4e4c-8165-e56fcfb1f730 could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:31:16 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-76592093-ac5f-45ba-a3f5-89c3faadaa7e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730" status: 404 len: 111 microversion: 2.1 time: 0.035501 Apr 11 17:31:16 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 374/1123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:31:16 2023] GET /compute/v2.1/servers/4d149c96-1eca-4e4c-8165-e56fcfb1f730 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:31:17 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0 HTTP/1.1 Apr 11 17:31:17 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:31:17 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:31:17 user devstack@n-api.service[61422]: Connection: close Apr 11 17:31:17 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:31:17 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:31:17 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:31:17 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:31:17 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:17 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:31:17 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:31:17 user devstack@n-api.service[61422]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:17 user devstack@n-api.service[61422]: method: > Apr 11 17:31:17 user devstack@n-api.service[61422]: exception: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:31:17 user devstack@n-api.service[61422]: action_args: {'id': '3b9f0853-b703-414b-ba98-72215c25f3c0'} Apr 11 17:31:17 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:31:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8b2ef512-a729-427b-b865-f6dae7b8f524 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0" status: 404 len: 111 microversion: 2.1 time: 0.041878 Apr 11 17:31:17 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 374/1124] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:31:17 2023] DELETE /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:31:17 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:17 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 3b9f0853-b703-414b-ba98-72215c25f3c0] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:17 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:17 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:31:17 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:31:17 user devstack@n-api.service[61424]: request: GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0 HTTP/1.1 Apr 11 17:31:17 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:31:17 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:31:17 user devstack@n-api.service[61424]: Connection: close Apr 11 17:31:17 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:31:17 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:31:17 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:31:17 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:31:17 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:17 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61424]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:17 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:31:17 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:31:17 user devstack@n-api.service[61424]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:31:17 user devstack@n-api.service[61424]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:17 user devstack@n-api.service[61424]: method: > Apr 11 17:31:17 user devstack@n-api.service[61424]: exception: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:31:17 user devstack@n-api.service[61424]: action_args: {'id': '3b9f0853-b703-414b-ba98-72215c25f3c0'} Apr 11 17:31:17 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. Apr 11 17:31:17 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance 3b9f0853-b703-414b-ba98-72215c25f3c0 could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:31:17 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-18af8169-a1aa-4523-913a-66806c501918 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0" status: 404 len: 111 microversion: 2.1 time: 0.030837 Apr 11 17:31:17 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 377/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:31:17 2023] GET /compute/v2.1/servers/3b9f0853-b703-414b-ba98-72215c25f3c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:31:17 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:17 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:17 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:17 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:31:17 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:31:17 user devstack@n-api.service[61423]: request: DELETE /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc HTTP/1.1 Apr 11 17:31:17 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:31:17 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:31:17 user devstack@n-api.service[61423]: Connection: close Apr 11 17:31:17 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:31:17 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:31:17 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:31:17 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:31:17 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:17 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61423]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:17 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:31:17 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:31:17 user devstack@n-api.service[61423]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:31:17 user devstack@n-api.service[61423]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:17 user devstack@n-api.service[61423]: method: > Apr 11 17:31:17 user devstack@n-api.service[61423]: exception: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:31:17 user devstack@n-api.service[61423]: action_args: {'id': '0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc'} Apr 11 17:31:17 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:31:17 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:31:17 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2159374b-eb80-4a5c-9228-f8a172ce4b50 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" status: 404 len: 111 microversion: 2.1 time: 0.032254 Apr 11 17:31:17 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 375/1126] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:31:17 2023] DELETE /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:31:17 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc HTTP/1.1 Apr 11 17:31:17 user devstack@n-api.service[61422]: Accept: application/json Apr 11 17:31:17 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 11 17:31:17 user devstack@n-api.service[61422]: Connection: close Apr 11 17:31:17 user devstack@n-api.service[61422]: Content-Length: 0 Apr 11 17:31:17 user devstack@n-api.service[61422]: Content-Type: application/json Apr 11 17:31:17 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 11 17:31:17 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 11 17:31:17 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Role: reader,member Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Roles: reader,member Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:17 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 11 17:31:17 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 11 17:31:17 user devstack@n-api.service[61422]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:31:17 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:17 user devstack@n-api.service[61422]: method: > Apr 11 17:31:17 user devstack@n-api.service[61422]: exception: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:31:17 user devstack@n-api.service[61422]: action_args: {'id': '0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc'} Apr 11 17:31:17 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. Apr 11 17:31:17 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 11 17:31:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance 0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:31:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-5920a384-b32c-4af0-a4d6-90e37f8aa17e tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc" status: 404 len: 111 microversion: 2.1 time: 0.032793 Apr 11 17:31:17 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 375/1127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:31:17 2023] GET /compute/v2.1/servers/0ca6c94b-72e6-4ce1-a6af-b0a3d74749bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:31:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:18 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:18 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.wsgi [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:31:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:31:18 user devstack@n-api.service[61424]: request: DELETE /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb HTTP/1.1 Apr 11 17:31:18 user devstack@n-api.service[61424]: Accept: application/json Apr 11 17:31:18 user devstack@n-api.service[61424]: Accept-Encoding: identity Apr 11 17:31:18 user devstack@n-api.service[61424]: Connection: close Apr 11 17:31:18 user devstack@n-api.service[61424]: Content-Length: 0 Apr 11 17:31:18 user devstack@n-api.service[61424]: Content-Type: application/json Apr 11 17:31:18 user devstack@n-api.service[61424]: Host: 10.0.0.210 Apr 11 17:31:18 user devstack@n-api.service[61424]: Openstack-System-Scope: None Apr 11 17:31:18 user devstack@n-api.service[61424]: User-Agent: python-urllib3/1.26.15 Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Domain-Id: None Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Domain-Name: None Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Identity-Status: Confirmed Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Is-Admin-Project: True Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Project-Domain-Id: default Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Project-Domain-Name: Default Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Role: reader,member Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Roles: reader,member Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:18 user devstack@n-api.service[61424]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:18 user devstack@n-api.service[61424]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:18 user devstack@n-api.service[61424]: X-User-Domain-Id: default Apr 11 17:31:18 user devstack@n-api.service[61424]: X-User-Domain-Name: Default Apr 11 17:31:18 user devstack@n-api.service[61424]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:31:18 user devstack@n-api.service[61424]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:18 user devstack@n-api.service[61424]: method: > Apr 11 17:31:18 user devstack@n-api.service[61424]: exception: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:31:18 user devstack@n-api.service[61424]: action_args: {'id': 'b5f9fe94-98f0-4094-8003-53c06cbfd5cb'} Apr 11 17:31:18 user devstack@n-api.service[61424]: {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:31:18 user devstack@n-api.service[61424]: ERROR nova.api.openstack.wsgi Apr 11 17:31:18 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. {{(pid=61424) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:31:18 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-6b2c7ad3-f543-4239-bf67-808a209cbcc6 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb" status: 404 len: 111 microversion: 2.1 time: 0.031775 Apr 11 17:31:18 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 378/1128] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:31:18 2023] DELETE /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 17:31:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:18 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] [instance: b5f9fe94-98f0-4094-8003-53c06cbfd5cb] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:18 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:18 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] HTTP exception thrown: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:31:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Request method failure captured: Apr 11 17:31:18 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb HTTP/1.1 Apr 11 17:31:18 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:31:18 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:31:18 user devstack@n-api.service[61423]: Connection: close Apr 11 17:31:18 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:31:18 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:31:18 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:31:18 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:31:18 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZYavdFnUhXtdbm5WJOcOLb5wCVgCPWRBpYjOnKpHCRSlxbBuHAKoymFpKrpRr7kNp--xwWvVxiDa8X6NMTTnhTrRRYcNF_jV1UdF802aZ-rqMfef4ljUbdjog81ZdhlA-SiU-hvPgm3NA7FpwJkDi16r60RLWAqYFc8RVlSaGTAQ5c Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Project-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Project-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/23c663a759724bbda32f189ceedf6675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/23c663a759724bbda32f189ceedf6675"}]}] Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Tenant: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Tenant-Id: 23c663a759724bbda32f189ceedf6675 Apr 11 17:31:18 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1862265490 Apr 11 17:31:18 user devstack@n-api.service[61423]: X-User: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:18 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:31:18 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:31:18 user devstack@n-api.service[61423]: X-User-Id: ff27d08254f74491aba3386c9b901300 Apr 11 17:31:18 user devstack@n-api.service[61423]: X-User-Name: tempest-AttachVolumeNegativeTest-1862265490-project-member Apr 11 17:31:18 user devstack@n-api.service[61423]: method: > Apr 11 17:31:18 user devstack@n-api.service[61423]: exception: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:31:18 user devstack@n-api.service[61423]: action_args: {'id': 'b5f9fe94-98f0-4094-8003-53c06cbfd5cb'} Apr 11 17:31:18 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. Apr 11 17:31:18 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:31:18 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] Returning 404 to user: Instance b5f9fe94-98f0-4094-8003-53c06cbfd5cb could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:31:18 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-ee13bc76-3e6b-49f1-9565-a915ae2a24a4 tempest-AttachVolumeNegativeTest-1862265490 tempest-AttachVolumeNegativeTest-1862265490-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb" status: 404 len: 111 microversion: 2.1 time: 0.033940 Apr 11 17:31:18 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 376/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:31:18 2023] GET /compute/v2.1/servers/b5f9fe94-98f0-4094-8003-53c06cbfd5cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:31:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-897b094b-405d-411b-9853-9ca0de0caa40 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:25 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-897b094b-405d-411b-9853-9ca0de0caa40 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-897b094b-405d-411b-9853-9ca0de0caa40 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-897b094b-405d-411b-9853-9ca0de0caa40 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-897b094b-405d-411b-9853-9ca0de0caa40 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-897b094b-405d-411b-9853-9ca0de0caa40 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-897b094b-405d-411b-9853-9ca0de0caa40 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-897b094b-405d-411b-9853-9ca0de0caa40 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:25 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-897b094b-405d-411b-9853-9ca0de0caa40 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f53effabdb4b80aec41b67f3bad208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9352d5bd04c5433c8233473a0a5a9cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:31:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-897b094b-405d-411b-9853-9ca0de0caa40 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b" status: 200 len: 1568 microversion: 2.1 time: 0.198678 Apr 11 17:31:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 376/1130] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:31:25 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:31:28 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259f5df3-9c93-4e5e-82cc-5c350632534b", "tag": "363c768e-4cdf-4715-98c4-1bfce1e81e49"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:31:28 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:28 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:28 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] Creating event network-changed:363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b on user Apr 11 17:31:28 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-b6ebb6fc-38e6-476f-806e-e5e0f7063847 req-6067e138-3a41-42b2-8f1c-094343222e42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032557 Apr 11 17:31:28 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 379/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:31:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:31:29 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b0196b8-5f51-481e-b825-8b35763b7e73"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:31:29 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:29 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:29 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=8 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:29 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:29 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-0d764651-d550-4944-9d96-8c975953e32b tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "POST /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306906 Apr 11 17:31:29 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 377/1132] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:31:29 2023] POST /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:31:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:40 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:40 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:40 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=10 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:40 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'services' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:31:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b289d62e-0943-4248-9b36-2184ab42636e tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments/6b0196b8-5f51-481e-b825-8b35763b7e73" status: 202 len: 0 microversion: 2.1 time: 0.174196 Apr 11 17:31:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 377/1133] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:31:40 2023] DELETE /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments/6b0196b8-5f51-481e-b825-8b35763b7e73 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:31:41 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:41 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:31:41 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-aef4e65b-3238-4c53-8291-d3fb945e8c75 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:31:41 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-aef4e65b-3238-4c53-8291-d3fb945e8c75 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:31:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aef4e65b-3238-4c53-8291-d3fb945e8c75 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aef4e65b-3238-4c53-8291-d3fb945e8c75 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aef4e65b-3238-4c53-8291-d3fb945e8c75 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aef4e65b-3238-4c53-8291-d3fb945e8c75 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:31:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aef4e65b-3238-4c53-8291-d3fb945e8c75 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:31:41 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-aef4e65b-3238-4c53-8291-d3fb945e8c75 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:31:41 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-aef4e65b-3238-4c53-8291-d3fb945e8c75 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054718 Apr 11 17:31:41 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 380/1134] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:31:41 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:32:31 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:32:31 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:32:31 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-de1a1a0f-e129-439d-be4a-8cba22f04340 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:32:31 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-de1a1a0f-e129-439d-be4a-8cba22f04340 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:32:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1a1a0f-e129-439d-be4a-8cba22f04340 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:32:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1a1a0f-e129-439d-be4a-8cba22f04340 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:32:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1a1a0f-e129-439d-be4a-8cba22f04340 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:32:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1a1a0f-e129-439d-be4a-8cba22f04340 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:32:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1a1a0f-e129-439d-be4a-8cba22f04340 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:32:31 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-de1a1a0f-e129-439d-be4a-8cba22f04340 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:32:31 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-de1a1a0f-e129-439d-be4a-8cba22f04340 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057670 Apr 11 17:32:31 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 378/1135] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:32:31 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:32:32 user devstack@n-api.service[61422]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef43f10d-bf18-46eb-b2d9-aef6af8c17fd] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 17:32:32 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:32:32 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:32:32 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59f26f1b-e186-403f-8c6e-32b608933595"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:32:32 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:32:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:32:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:32:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:32:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:32:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:32:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:32:33 user devstack@n-api.service[61422]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef43f10d-bf18-46eb-b2d9-aef6af8c17fd] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 58466. Apr 11 17:32:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-dbe531f7-8c36-4882-ab35-dcdfbd73b829 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "POST /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.155433 Apr 11 17:32:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 378/1136] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:32:32 2023] POST /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 194 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:32:40 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:32:40 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:32:40 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:32:40 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=6 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:32:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:32:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:32:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:32:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:32:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:32:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:32:40 user devstack@n-api.service[61424]: DEBUG nova.objects.instance [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'services' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=61424) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:32:40 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-4a8b1ac9-5c8e-4c1d-a518-90a0c693f279 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments/59f26f1b-e186-403f-8c6e-32b608933595" status: 202 len: 0 microversion: 2.1 time: 0.172204 Apr 11 17:32:40 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 381/1137] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:32:40 2023] DELETE /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments/59f26f1b-e186-403f-8c6e-32b608933595 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:32:40 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-6d29fbb7-1341-4f7d-8eca-b908bfeaca02 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:32:40 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-6d29fbb7-1341-4f7d-8eca-b908bfeaca02 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:32:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6d29fbb7-1341-4f7d-8eca-b908bfeaca02 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:32:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6d29fbb7-1341-4f7d-8eca-b908bfeaca02 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:32:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6d29fbb7-1341-4f7d-8eca-b908bfeaca02 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:32:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6d29fbb7-1341-4f7d-8eca-b908bfeaca02 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:32:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6d29fbb7-1341-4f7d-8eca-b908bfeaca02 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:32:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6d29fbb7-1341-4f7d-8eca-b908bfeaca02 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:32:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-6d29fbb7-1341-4f7d-8eca-b908bfeaca02 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042907 Apr 11 17:32:41 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 379/1138] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:32:40 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:33:31 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:33:31 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:33:31 user devstack@n-api.service[61422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 17:33:31 user devstack@n-api.service[61422]: Tue Apr 11 17:33:31 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments (ip 10.0.0.210) !!! Apr 11 17:33:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ebdcd004-a9bc-4c4c-b59e-4e437a103902 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:33:31 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ebdcd004-a9bc-4c4c-b59e-4e437a103902 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:33:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ebdcd004-a9bc-4c4c-b59e-4e437a103902 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:33:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ebdcd004-a9bc-4c4c-b59e-4e437a103902 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:33:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ebdcd004-a9bc-4c4c-b59e-4e437a103902 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:33:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ebdcd004-a9bc-4c4c-b59e-4e437a103902 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:33:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ebdcd004-a9bc-4c4c-b59e-4e437a103902 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:33:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ebdcd004-a9bc-4c4c-b59e-4e437a103902 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:33:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ebdcd004-a9bc-4c4c-b59e-4e437a103902 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051641 Apr 11 17:33:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 379/1139] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:33:31 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:33:32 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:33:32 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:33:32 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cfe301b-d25c-41bc-8221-8fa2d84cff7f"}} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:33:32 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:33:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:33:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:33:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:33:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:33:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:33:32 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:33:32 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-31020834-61c2-4337-ba54-1960459f2a84 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "POST /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284634 Apr 11 17:33:32 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 382/1140] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:33:32 2023] POST /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 17:33:40 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:33:40 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:33:40 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:33:40 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=12 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:33:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:33:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:33:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:33:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:33:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:33:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:33:41 user devstack@n-api.service[61423]: DEBUG nova.objects.instance [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'services' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=61423) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:33:41 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-6b7faa8c-1f80-4df0-8a75-6e94b055236f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments/1cfe301b-d25c-41bc-8221-8fa2d84cff7f" status: 202 len: 0 microversion: 2.1 time: 0.180403 Apr 11 17:33:41 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 380/1141] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:33:40 2023] DELETE /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments/1cfe301b-d25c-41bc-8221-8fa2d84cff7f => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:33:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-367ed300-8a30-4787-8e26-70153a93d9bc tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:33:41 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-367ed300-8a30-4787-8e26-70153a93d9bc tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:33:41 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:33:41 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:33:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-367ed300-8a30-4787-8e26-70153a93d9bc tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:33:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-367ed300-8a30-4787-8e26-70153a93d9bc tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:33:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-367ed300-8a30-4787-8e26-70153a93d9bc tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:33:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-367ed300-8a30-4787-8e26-70153a93d9bc tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:33:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-367ed300-8a30-4787-8e26-70153a93d9bc tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:33:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-367ed300-8a30-4787-8e26-70153a93d9bc tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:33:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-367ed300-8a30-4787-8e26-70153a93d9bc tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049402 Apr 11 17:33:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 380/1142] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:33:41 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:34:31 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=2 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:34:31 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:34:31 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-6bede957-9e51-4677-99d1-82b0cec245f7 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:34:31 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-6bede957-9e51-4677-99d1-82b0cec245f7 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:34:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6bede957-9e51-4677-99d1-82b0cec245f7 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:34:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6bede957-9e51-4677-99d1-82b0cec245f7 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:34:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6bede957-9e51-4677-99d1-82b0cec245f7 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:34:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6bede957-9e51-4677-99d1-82b0cec245f7 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:34:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6bede957-9e51-4677-99d1-82b0cec245f7 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:34:31 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-6bede957-9e51-4677-99d1-82b0cec245f7 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:34:31 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-6bede957-9e51-4677-99d1-82b0cec245f7 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111448 Apr 11 17:34:31 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 383/1143] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:34:31 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:34:32 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:34:32 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:34:32 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "250c8678-d72d-49c8-9830-3533768276fc"}} {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:34:32 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:34:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:34:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:34:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:34:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:34:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:34:32 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:34:33 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-e105b15f-fb30-4f98-a9c6-698627c68316 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "POST /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.559406 Apr 11 17:34:33 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 381/1144] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 17:34:32 2023] POST /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 194 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:34:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:34:40 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:34:40 user devstack@n-api.service[61422]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 17:34:40 user devstack@n-api.service[61422]: Tue Apr 11 17:34:40 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments/250c8678-d72d-49c8-9830-3533768276fc (ip 10.0.0.210) !!! Apr 11 17:34:40 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:34:40 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:34:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:34:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:34:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:34:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:34:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:34:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:34:40 user devstack@n-api.service[61422]: DEBUG nova.objects.instance [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lazy-loading 'services' on Instance uuid 259f5df3-9c93-4e5e-82cc-5c350632534b {{(pid=61422) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 17:34:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9caeb715-d5b6-429d-ada4-25cf19e81070 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments/250c8678-d72d-49c8-9830-3533768276fc" status: 202 len: 0 microversion: 2.1 time: 0.251756 Apr 11 17:34:40 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 381/1145] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 17:34:40 2023] DELETE /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments/250c8678-d72d-49c8-9830-3533768276fc => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 17:34:40 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-c6abb948-dd18-46c2-baf2-3ab497e628a1 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:34:40 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-c6abb948-dd18-46c2-baf2-3ab497e628a1 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:34:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c6abb948-dd18-46c2-baf2-3ab497e628a1 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:34:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c6abb948-dd18-46c2-baf2-3ab497e628a1 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:34:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c6abb948-dd18-46c2-baf2-3ab497e628a1 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:34:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c6abb948-dd18-46c2-baf2-3ab497e628a1 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:34:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c6abb948-dd18-46c2-baf2-3ab497e628a1 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:34:40 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-c6abb948-dd18-46c2-baf2-3ab497e628a1 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:34:40 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-c6abb948-dd18-46c2-baf2-3ab497e628a1 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069026 Apr 11 17:34:40 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 384/1146] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:34:40 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:35:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-2515b320-d746-4ce6-a290-4b543ac9ccd5 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:35:30 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-2515b320-d746-4ce6-a290-4b543ac9ccd5 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:35:30 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=2 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:35:30 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:35:30 user devstack@n-api.service[61423]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 17:35:30 user devstack@n-api.service[61423]: Tue Apr 11 17:35:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments (ip 10.0.0.210) !!! Apr 11 17:35:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2515b320-d746-4ce6-a290-4b543ac9ccd5 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:35:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2515b320-d746-4ce6-a290-4b543ac9ccd5 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:35:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2515b320-d746-4ce6-a290-4b543ac9ccd5 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:35:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2515b320-d746-4ce6-a290-4b543ac9ccd5 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:35:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2515b320-d746-4ce6-a290-4b543ac9ccd5 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:35:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-2515b320-d746-4ce6-a290-4b543ac9ccd5 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:35:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-2515b320-d746-4ce6-a290-4b543ac9ccd5 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073107 Apr 11 17:35:30 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 382/1147] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 17:35:30 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 17:35:38 user devstack@n-api.service[61422]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef43f10d-bf18-46eb-b2d9-aef6af8c17fd] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 11 17:35:38 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:35:38 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:35:38 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "259f5df3-9c93-4e5e-82cc-5c350632534b", "tag": "363c768e-4cdf-4715-98c4-1bfce1e81e49"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:35:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:35:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:35:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:35:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] Creating event network-changed:363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b on user Apr 11 17:35:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-3cbd92da-4402-4068-8860-1e041d268ac6 req-8d9b232d-9063-4411-b6b2-b5358c31baef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116986 Apr 11 17:35:38 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 382/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:35:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:35:39 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:35:39 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61424) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:35:39 user devstack@n-api.service[61424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 17:35:39 user devstack@n-api.service[61424]: Tue Apr 11 17:35:39 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b (ip 10.0.0.210) !!! Apr 11 17:35:39 user devstack@n-api.service[61424]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 17:35:39 user devstack@n-api.service[61424]: Tue Apr 11 17:35:39 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b (ip 10.0.0.210) !!! Apr 11 17:35:39 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_api:SELECT=4 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:35:39 user devstack@n-api.service[61424]: DEBUG dbcounter [-] [61424] Writing DB stats nova_cell1:SELECT=12 {{(pid=61424) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:35:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:35:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:35:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:35:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:35:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:35:39 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:35:39 user devstack@n-api.service[61424]: DEBUG nova.compute.api [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Going to try to terminate instance {{(pid=61424) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 17:35:40 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [None req-07a1206a-394f-4689-aa3f-7ffc3b30d570 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b" status: 204 len: 0 microversion: 2.1 time: 0.162840 Apr 11 17:35:40 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 385/1149] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 17:35:39 2023] DELETE /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 17:35:40 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-7eb49655-cda2-4a28-a58c-3166ca7fcf17 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:35:40 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-7eb49655-cda2-4a28-a58c-3166ca7fcf17 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:35:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7eb49655-cda2-4a28-a58c-3166ca7fcf17 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:35:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7eb49655-cda2-4a28-a58c-3166ca7fcf17 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:35:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7eb49655-cda2-4a28-a58c-3166ca7fcf17 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:35:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7eb49655-cda2-4a28-a58c-3166ca7fcf17 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:35:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7eb49655-cda2-4a28-a58c-3166ca7fcf17 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:35:40 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-7eb49655-cda2-4a28-a58c-3166ca7fcf17 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:35:40 user devstack@n-api.service[61423]: DEBUG nova.policy [None req-7eb49655-cda2-4a28-a58c-3166ca7fcf17 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f53effabdb4b80aec41b67f3bad208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9352d5bd04c5433c8233473a0a5a9cfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61423) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 17:35:40 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-7eb49655-cda2-4a28-a58c-3166ca7fcf17 tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b" status: 200 len: 1574 microversion: 2.1 time: 0.180928 Apr 11 17:35:40 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 383/1150] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:35:40 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 17:35:40 user devstack@n-api.service[61422]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef43f10d-bf18-46eb-b2d9-aef6af8c17fd] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41056. Apr 11 17:35:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259f5df3-9c93-4e5e-82cc-5c350632534b", "name": "network-vif-unplugged", "status": "completed", "tag": "363c768e-4cdf-4715-98c4-1bfce1e81e49"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:35:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:35:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:35:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:35:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] Creating event network-vif-unplugged:363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b on user Apr 11 17:35:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-10c866c5-9779-4179-a586-ee4b91852999 req-292cd680-d9ff-42f4-96c8-33a5950f63b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084793 Apr 11 17:35:40 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 383/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:35:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:35:42 user devstack@n-api.service[61424]: DEBUG nova.api.openstack.wsgi [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "259f5df3-9c93-4e5e-82cc-5c350632534b", "name": "network-vif-plugged", "status": "completed", "tag": "363c768e-4cdf-4715-98c4-1bfce1e81e49"}, {"server_uuid": "259f5df3-9c93-4e5e-82cc-5c350632534b", "name": "network-vif-deleted", "tag": "363c768e-4cdf-4715-98c4-1bfce1e81e49"}]} {{(pid=61424) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 17:35:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:35:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:35:42 user devstack@n-api.service[61424]: DEBUG oslo_concurrency.lockutils [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61424) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:35:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] Creating event network-vif-plugged:363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b on user Apr 11 17:35:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.compute.server_external_events [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] Creating event network-vif-deleted:363c768e-4cdf-4715-98c4-1bfce1e81e49 for instance 259f5df3-9c93-4e5e-82cc-5c350632534b on user Apr 11 17:35:42 user devstack@n-api.service[61424]: INFO nova.api.openstack.requestlog [req-79f4a070-8484-4151-b746-26403ea8eb53 req-ba28dbeb-ddfb-4eff-9bcf-7d8cf932834d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037628 Apr 11 17:35:42 user devstack@n-api.service[61424]: [pid: 61424|app: 0|req: 386/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 17:35:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '>' {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG nova.compute.api [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] [instance: 259f5df3-9c93-4e5e-82cc-5c350632534b] Fetching instance by UUID {{(pid=61423) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 17:36:30 user devstack@n-api.service[61423]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 17:36:30 user devstack@n-api.service[61423]: Tue Apr 11 17:36:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b (ip 10.0.0.210) !!! Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_api:SELECT=4 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG dbcounter [-] [61423] Writing DB stats nova_cell1:SELECT=12 {{(pid=61423) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Acquiring lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG oslo_concurrency.lockutils [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Lock "78278d60-2ff1-4f3e-b533-dd913418cbaf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61423) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 17:36:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.wsgi [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] HTTP exception thrown: Instance 259f5df3-9c93-4e5e-82cc-5c350632534b could not be found. Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Request method failure captured: Apr 11 17:36:30 user devstack@n-api.service[61423]: request: GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b HTTP/1.1 Apr 11 17:36:30 user devstack@n-api.service[61423]: Accept: application/json Apr 11 17:36:30 user devstack@n-api.service[61423]: Accept-Encoding: identity Apr 11 17:36:30 user devstack@n-api.service[61423]: Connection: close Apr 11 17:36:30 user devstack@n-api.service[61423]: Content-Length: 0 Apr 11 17:36:30 user devstack@n-api.service[61423]: Content-Type: application/json Apr 11 17:36:30 user devstack@n-api.service[61423]: Host: 10.0.0.210 Apr 11 17:36:30 user devstack@n-api.service[61423]: Openstack-System-Scope: None Apr 11 17:36:30 user devstack@n-api.service[61423]: User-Agent: python-urllib3/1.26.15 Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Auth-Token: gAAAAABkNZj2jxeUk8YjG9UL6Tci8cI3VkW7nqQBu0934QjQoXqCQTbnv2FOcn58urWUpECWgdRGzcs5EQLUeIrhHO2kMxde2SNmrHQ7LZYi8GmYy4Q6p7vNQql16p5HkEcRh4KZeAn4o2s0uPCaOzPRpQf0QKgkUNfK07OmIaMymuM4omVtKWw Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Domain-Id: None Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Domain-Name: None Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Identity-Status: Confirmed Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Is-Admin-Project: True Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Project-Domain-Id: default Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Project-Domain-Name: Default Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Project-Id: 9352d5bd04c5433c8233473a0a5a9cfe Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Project-Name: tempest-SnapshotDataIntegrityTests-946316985 Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Role: reader,member Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Roles: reader,member Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9352d5bd04c5433c8233473a0a5a9cfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9352d5bd04c5433c8233473a0a5a9cfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9352d5bd04c5433c8233473a0a5a9cfe"}]}] Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Tenant: tempest-SnapshotDataIntegrityTests-946316985 Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Tenant-Id: 9352d5bd04c5433c8233473a0a5a9cfe Apr 11 17:36:30 user devstack@n-api.service[61423]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-946316985 Apr 11 17:36:30 user devstack@n-api.service[61423]: X-User: tempest-SnapshotDataIntegrityTests-946316985-project-member Apr 11 17:36:30 user devstack@n-api.service[61423]: X-User-Domain-Id: default Apr 11 17:36:30 user devstack@n-api.service[61423]: X-User-Domain-Name: Default Apr 11 17:36:30 user devstack@n-api.service[61423]: X-User-Id: 54f53effabdb4b80aec41b67f3bad208 Apr 11 17:36:30 user devstack@n-api.service[61423]: X-User-Name: tempest-SnapshotDataIntegrityTests-946316985-project-member Apr 11 17:36:30 user devstack@n-api.service[61423]: method: > Apr 11 17:36:30 user devstack@n-api.service[61423]: exception: Instance 259f5df3-9c93-4e5e-82cc-5c350632534b could not be found. Apr 11 17:36:30 user devstack@n-api.service[61423]: action_args: {'id': '259f5df3-9c93-4e5e-82cc-5c350632534b'} Apr 11 17:36:30 user devstack@n-api.service[61423]: {{(pid=61423) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 259f5df3-9c93-4e5e-82cc-5c350632534b could not be found. Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 259f5df3-9c93-4e5e-82cc-5c350632534b could not be found. Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 259f5df3-9c93-4e5e-82cc-5c350632534b could not be found. Apr 11 17:36:30 user devstack@n-api.service[61423]: ERROR nova.api.openstack.wsgi Apr 11 17:36:30 user devstack@n-api.service[61423]: DEBUG nova.api.openstack.wsgi [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Returning 404 to user: Instance 259f5df3-9c93-4e5e-82cc-5c350632534b could not be found. {{(pid=61423) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 17:36:30 user devstack@n-api.service[61423]: INFO nova.api.openstack.requestlog [None req-0e212763-6d80-4637-8d9b-fce1b43e3b5f tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b" status: 404 len: 111 microversion: 2.1 time: 0.041575 Apr 11 17:36:30 user devstack@n-api.service[61423]: [pid: 61423|app: 0|req: 384/1153] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 17:36:30 2023] GET /compute/v2.1/servers/259f5df3-9c93-4e5e-82cc-5c350632534b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 17:36:30 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:36:30 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 17:36:30 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-77a554ca-aacb-4166-aed5-2755b860395d tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] Calling method '.version_select at 0x7f5bdd6f5c60>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 17:36:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-77a554ca-aacb-4166-aed5-2755b860395d tempest-SnapshotDataIntegrityTests-946316985 tempest-SnapshotDataIntegrityTests-946316985-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-338437608" status: 202 len: 0 microversion: 2.1 time: 0.034422 Apr 11 17:36:30 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 384/1154] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 17:36:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-338437608 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)